{"id":378,"date":"2017-04-24T21:10:00","date_gmt":"2017-04-24T21:10:00","guid":{"rendered":"https:\/\/questy.org\/?p=378"},"modified":"2024-09-26T19:02:37","modified_gmt":"2024-09-26T19:02:37","slug":"scaling-puppet-enterprise-part-iv-activemq-hub-and-spokes","status":"publish","type":"post","link":"https:\/\/questy.org\/index.php\/2017\/04\/24\/scaling-puppet-enterprise-part-iv-activemq-hub-and-spokes\/","title":{"rendered":"Scaling Puppet Enterprise – Part IV – ActiveMQ Hub and Spokes"},"content":{"rendered":"\n

As in the previous installment, you need to have already completed a few steps before arriving at this post. You should have already completed a “split installation” (Documented here<\/a>). Also, your load balancer needs to be configured and running. The procedure for this portion can be found here<\/a>. Finally, you should have the additional compilers installed and configured along with two example agent nodes as covered here<\/a> and here<\/a>.. If you’ve completed all these portions, you are now ready to configure ActiveMQ for scaling MCollective.<\/em><\/strong><\/p>\n\n\n\n

Once the preceding items are performed, you may find it necessary to add ActiveMQ hubs and spokes to increase capacity for MCollective and\/or the Code Sync and Code Manager functions of Puppet Enterprise. This installment documents how to install these additional components and tie them into the existing infrastructure.<\/p>\n\n\n\n

Create an ActiveMQ Hub<\/h3>\n\n\n\n
    \n
  1. Go to the Puppet Enterprise Console in your browser.<\/li>\n\n\n\n
  2. Select Nodes | Classification<\/strong> and create a new group called “PE ActiveMQ Hub”<\/strong><\/li>\n\n\n\n
  3. Stand up two new nodes for the ActiveMQ Hub and Spoke (in our example, activemq-hub.example.com<\/strong> and activemq-spoke.example.com<\/strong>) according to the following specifications:<\/li>\n<\/ol>\n\n\n\n
    \"\"<\/figure>\n\n\n\n

    Once your nodes have been provisioned, install the Puppet Agent on each node, making sure to point the installer DIRECTLY at the MoM (<\/strong>master.example.com**) instead of at the compiler VIP.<\/p>\n\n\n\n

    curl -k https:\/\/master.example.com:8140\/packages\/current\/install.bash | bash<\/code><\/pre>\n\n\n\n
    and let the agent install complete in its entirety.<\/p>\n\n\n\n
    Next, from your browser, retrieve the Puppet Enterprise Console and select the “PE ActiveMQ Hub<\/strong>” group you created earlier. Pin the activemq-hub.example.com<\/strong> node into the PE ActiveMQ Hub<\/strong> group.<\/p>\n\n\n\n
      \n
    1. Select the “Classes<\/strong>” tab and add a new class entitled: “puppet_enterprise::profile::amq::hub<\/strong>“<\/li>\n\n\n\n
    2. Click “Add Class<\/strong>“.<\/li>\n\n\n\n
    3. Under the Parameters drop-down, select “network_collector_spoke_collect_tag<\/strong>” and set its value to “pe-amq-network-connectors-for-activemq-hub.example.com<\/strong>“<\/li>\n\n\n\n
    4. Commit the changes.<\/li>\n\n\n\n
    5. SSH to the activemq-hub.example.com<\/strong> and run puppet agent -t<\/strong> to make all your changes effective for the Hub node.<\/li>\n<\/ol>\n\n\n\n
      Create ActiveMQ Spoke (or “broker”)<\/h3>\n\n\n\n
        \n
      1. In the Puppet Enterprise Console, Select Nodes | Classification | PE ActiveMQ Broker<\/strong><\/li>\n\n\n\n
      2. Pin your new ActiveMQ broker into the PE ActiveMQ Broker<\/strong> group.<\/li>\n\n\n\n
      3. Select the “Classes<\/strong>” tab.<\/li>\n\n\n\n
      4. Under the puppet_enterprise::profile::amp::broker<\/strong> class, choose the activemq_hubname<\/strong> parameter and set it to the FQDN of the hub you just created. In our case, activemq-hub.example.com<\/strong>.<\/li>\n\n\n\n
      5. SSH to the new broker (activemq-spoke.example.com<\/strong>) and run puppet agent -t<\/strong>.<\/li>\n\n\n\n
      6. Finally, unpin master.example.com<\/strong> from the PE ActiveMQ Broker<\/strong> group.<\/li>\n<\/ol>\n\n\n\n
        Conclusion<\/h3>\n\n\n\n
        At this point, you should have:<\/p>\n\n\n\n
          \n
        • Puppet Master of Masters – master.example.com<\/strong><\/li>\n\n\n\n
        • PuppetDB – puppetdb.example.com<\/strong><\/li>\n\n\n\n
        • PE Console – console.example.com<\/strong><\/li>\n\n\n\n
        • HAProxy Node – compiler.example.com<\/strong><\/li>\n\n\n\n
        • 2 Catalog compilers – compile1.example.com<\/strong> and compile2.example.com<\/strong><\/li>\n\n\n\n
        • An ActiveMQ Hub – activemq-hub.example.com<\/strong><\/li>\n\n\n\n
        • An ActiveMQ Spoke – activemq-spoke.example.com<\/strong><\/li>\n\n\n\n
        • Two Agent Nodes – agent1.example.com<\/strong> and agent2.example.com<\/strong><\/li>\n<\/ul>\n\n\n\n
          with their respective configurations. Your serving infrastructure is complete, and you are now ready to configure it for use.<\/p>\n","protected":false},"excerpt":{"rendered":"
          As in the previous installment, you need to have already completed a few steps before arriving at this post. You should have already completed a “split installation” (Documented here). Also, your load balancer needs to be configured and running. The procedure for this portion can be found here. Finally, you should have the additional compilers […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[2,4],"tags":[],"class_list":["post-378","post","type-post","status-publish","format-standard","hentry","category-puppet-administration","category-puppet-education"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_likes_enabled":true,"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/posts\/378","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/comments?post=378"}],"version-history":[{"count":1,"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/posts\/378\/revisions"}],"predecessor-version":[{"id":379,"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/posts\/378\/revisions\/379"}],"wp:attachment":[{"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/media?parent=378"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/categories?post=378"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/questy.org\/index.php\/wp-json\/wp\/v2\/tags?post=378"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}