Installing plugin takes a long time and sometimes errors out when installing the aws dependencies

[cdenneen]

@majormoses So I've been trying to install this plugin during acceptance testing and even pipeline builds and it always causes a HUGE bottleneck for the install.
So in taking your advice (https://github.com/sensu-plugins/community/blob/master/best_practices/production_deployments/plugins/WITHOUT_COMPILERS.md) and (sensu/sensu-puppet#908) I compiled unf_ext and nokogiri, uploaded to artifactory and installed prior to installing this gem and it's not helping (Maybe the document or this plugins README should be updated to handle the compiled dependencies in order to avoid needing compiler to be installed on the resulting client machine.

I took centos:7 image and preinstalled sensu to save me a step and here is the resulting output. As you can see the time it took to install this plugin took 6 minutes alone even after the dependency gems were installed. In our CI systems they don't have much memory or cpu and I've seen them take > 50 minutes for this step for some reason... (< 7m for full build if I remove just this plugin).

There has to be a better way to speed up this install.

~ » date
Fri Sep  7 13:35:27 EDT 2018
~ » docker run --rm -ti 089982837c4f bash
[root@88c43b3d21a8 /]# yum install which -y
Loaded plugins: fastestmirror, ovl
Loading mirror speeds from cached hostfile
epel/x86_64/metalink                                                                                                                                              |  17 kB  00:00:00
 * base: mirror.cc.columbia.edu
 * epel: mirror.umd.edu
 * extras: mirrors.advancedhosters.com
 * updates: mirror.trouble-free.net
base                                                                                                                                                              | 3.6 kB  00:00:00
epel                                                                                                                                                              | 3.2 kB  00:00:00
extras                                                                                                                                                            | 3.4 kB  00:00:00
sensu                                                                                                                                                             | 2.5 kB  00:00:00
updates                                                                                                                                                           | 3.4 kB  00:00:00
Resolving Dependencies
--> Running transaction check
---> Package which.x86_64 0:2.20-7.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=========================================================================================================================================================================================
 Package                                    Arch                                        Version                                          Repository                                 Size
=========================================================================================================================================================================================
Installing:
 which                                      x86_64                                      2.20-7.el7                                       base                                       41 k

Transaction Summary
=========================================================================================================================================================================================
Install  1 Package

Total download size: 41 k
Installed size: 75 k
Downloading packages:
which-2.20-7.el7.x86_64.rpm                                                                                                                                       |  41 kB  00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : which-2.20-7.el7.x86_64                                                                                                                                               1/1
install-info: No such file or directory for /usr/share/info/which.info.gz
  Verifying  : which-2.20-7.el7.x86_64                                                                                                                                               1/1

Installed:
  which.x86_64 0:2.20-7.el7

Complete!
[root@88c43b3d21a8 /]# gem install unf_ext --source https://artifactory.domain.com/api/gems/ap-rubygems-local-ruby24
Fetching: unf_ext-0.0.7.5-x86_64-linux.gem (100%)
Successfully installed unf_ext-0.0.7.5-x86_64-linux
Parsing documentation for unf_ext-0.0.7.5-x86_64-linux
Installing ri documentation for unf_ext-0.0.7.5-x86_64-linux
Done installing documentation for unf_ext after 0 seconds
1 gem installed
[root@88c43b3d21a8 /]# gem install nokogiri --source https://artifactory.domain.com/api/gems/ap-rubygems-local-ruby24
Fetching: mini_portile2-2.3.0.gem (100%)
Successfully installed mini_portile2-2.3.0
Fetching: nokogiri-1.8.4-x86_64-linux.gem (100%)
Successfully installed nokogiri-1.8.4-x86_64-linux
Parsing documentation for mini_portile2-2.3.0
Installing ri documentation for mini_portile2-2.3.0
Parsing documentation for nokogiri-1.8.4-x86_64-linux
Installing ri documentation for nokogiri-1.8.4-x86_64-linux
Done installing documentation for mini_portile2, nokogiri after 9 seconds
2 gems installed
[root@88c43b3d21a8 /]# date
Fri Sep  7 17:36:27 UTC 2018
[root@88c43b3d21a8 /]# /opt/sensu/bin/sensu-install -p aws
[SENSU-INSTALL] installing Sensu plugins ...
[SENSU-INSTALL] determining if Sensu gem 'sensu-plugins-aws' is already installed ...
false
[SENSU-INSTALL] Sensu plugin gems to be installed: ["sensu-plugins-aws"]
[SENSU-INSTALL] installing Sensu gem 'sensu-plugins-aws'
Fetching: aws-sigv4-1.0.3.gem (100%)
Successfully installed aws-sigv4-1.0.3
Fetching: aws-eventstream-1.0.1.gem (100%)
Successfully installed aws-eventstream-1.0.1
Fetching: aws-partitions-1.103.0.gem (100%)
Successfully installed aws-partitions-1.103.0
Fetching: jmespath-1.4.0.gem (100%)
Successfully installed jmespath-1.4.0
Fetching: aws-sdk-core-3.27.0.gem (100%)
Successfully installed aws-sdk-core-3.27.0
Fetching: aws-sdk-acm-1.11.0.gem (100%)
Successfully installed aws-sdk-acm-1.11.0
Fetching: aws-sdk-acmpca-1.4.0.gem (100%)
Successfully installed aws-sdk-acmpca-1.4.0
Fetching: aws-sdk-apigateway-1.16.0.gem (100%)
Successfully installed aws-sdk-apigateway-1.16.0
Fetching: aws-sdk-alexaforbusiness-1.9.0.gem (100%)
Successfully installed aws-sdk-alexaforbusiness-1.9.0
Fetching: aws-sdk-appstream-1.15.0.gem (100%)
Successfully installed aws-sdk-appstream-1.15.0
Fetching: aws-sdk-appsync-1.6.0.gem (100%)
Successfully installed aws-sdk-appsync-1.6.0
Fetching: aws-sdk-applicationautoscaling-1.13.0.gem (100%)
Successfully installed aws-sdk-applicationautoscaling-1.13.0
Fetching: aws-sdk-applicationdiscoveryservice-1.5.0.gem (100%)
Successfully installed aws-sdk-applicationdiscoveryservice-1.5.0
Fetching: aws-sdk-athena-1.3.0.gem (100%)
Successfully installed aws-sdk-athena-1.3.0
Fetching: aws-sdk-autoscaling-1.9.0.gem (100%)
Successfully installed aws-sdk-autoscaling-1.9.0
Fetching: aws-sdk-autoscalingplans-1.5.0.gem (100%)
Successfully installed aws-sdk-autoscalingplans-1.5.0
Fetching: aws-sdk-batch-1.7.0.gem (100%)
Successfully installed aws-sdk-batch-1.7.0
Fetching: aws-sdk-budgets-1.10.0.gem (100%)
Successfully installed aws-sdk-budgets-1.10.0
Fetching: aws-sdk-cloud9-1.4.0.gem (100%)
Successfully installed aws-sdk-cloud9-1.4.0
Fetching: aws-sdk-clouddirectory-1.7.0.gem (100%)
Successfully installed aws-sdk-clouddirectory-1.7.0
Fetching: aws-sdk-cloudformation-1.8.0.gem (100%)
Successfully installed aws-sdk-cloudformation-1.8.0
Fetching: aws-sdk-cloudfront-1.7.0.gem (100%)
Successfully installed aws-sdk-cloudfront-1.7.0
Fetching: aws-sdk-cloudhsm-1.6.0.gem (100%)
Successfully installed aws-sdk-cloudhsm-1.6.0
Fetching: aws-sdk-cloudhsmv2-1.5.0.gem (100%)
Successfully installed aws-sdk-cloudhsmv2-1.5.0
Fetching: aws-sdk-cloudsearch-1.3.0.gem (100%)
Successfully installed aws-sdk-cloudsearch-1.3.0
Fetching: aws-sdk-cloudsearchdomain-1.3.0.gem (100%)
Successfully installed aws-sdk-cloudsearchdomain-1.3.0
Fetching: aws-sdk-cloudtrail-1.3.0.gem (100%)
Successfully installed aws-sdk-cloudtrail-1.3.0
Fetching: aws-sdk-cloudwatch-1.8.0.gem (100%)
Successfully installed aws-sdk-cloudwatch-1.8.0
Fetching: aws-sdk-cloudwatchevents-1.7.0.gem (100%)
Successfully installed aws-sdk-cloudwatchevents-1.7.0
Fetching: aws-sdk-cloudwatchlogs-1.7.0.gem (100%)
Successfully installed aws-sdk-cloudwatchlogs-1.7.0
Fetching: aws-sdk-codebuild-1.17.0.gem (100%)
Successfully installed aws-sdk-codebuild-1.17.0
Fetching: aws-sdk-codecommit-1.7.0.gem (100%)
Successfully installed aws-sdk-codecommit-1.7.0
Fetching: aws-sdk-codedeploy-1.8.0.gem (100%)
Successfully installed aws-sdk-codedeploy-1.8.0
Fetching: aws-sdk-codepipeline-1.7.0.gem (100%)
Successfully installed aws-sdk-codepipeline-1.7.0
Fetching: aws-sdk-codestar-1.4.0.gem (100%)
Successfully installed aws-sdk-codestar-1.4.0
Fetching: aws-sdk-cognitoidentity-1.3.0.gem (100%)
Successfully installed aws-sdk-cognitoidentity-1.3.0
Fetching: aws-sdk-cognitoidentityprovider-1.8.0.gem (100%)
Successfully installed aws-sdk-cognitoidentityprovider-1.8.0
Fetching: aws-sdk-cognitosync-1.3.0.gem (100%)
Successfully installed aws-sdk-cognitosync-1.3.0
Fetching: aws-sdk-comprehend-1.5.0.gem (100%)
Successfully installed aws-sdk-comprehend-1.5.0
Fetching: aws-sdk-configservice-1.15.0.gem (100%)
Successfully installed aws-sdk-configservice-1.15.0
Fetching: aws-sdk-connect-1.4.0.gem (100%)
Successfully installed aws-sdk-connect-1.4.0
Fetching: aws-sdk-costexplorer-1.9.0.gem (100%)
Successfully installed aws-sdk-costexplorer-1.9.0
Fetching: aws-sdk-costandusagereportservice-1.3.0.gem (100%)
Successfully installed aws-sdk-costandusagereportservice-1.3.0
Fetching: aws-sdk-dax-1.5.0.gem (100%)
Successfully installed aws-sdk-dax-1.5.0
Fetching: aws-sdk-dlm-1.3.0.gem (100%)
Successfully installed aws-sdk-dlm-1.3.0
Fetching: aws-sdk-datapipeline-1.3.0.gem (100%)
Successfully installed aws-sdk-datapipeline-1.3.0
Fetching: aws-sdk-databasemigrationservice-1.9.0.gem (100%)
Successfully installed aws-sdk-databasemigrationservice-1.9.0
Fetching: aws-sdk-devicefarm-1.10.0.gem (100%)
Successfully installed aws-sdk-devicefarm-1.10.0
Fetching: aws-sdk-directconnect-1.5.0.gem (100%)
Successfully installed aws-sdk-directconnect-1.5.0
Fetching: aws-sdk-directoryservice-1.5.0.gem (100%)
Successfully installed aws-sdk-directoryservice-1.5.0
Fetching: aws-sdk-dynamodb-1.13.0.gem (100%)
Successfully installed aws-sdk-dynamodb-1.13.0
Fetching: aws-sdk-dynamodbstreams-1.3.0.gem (100%)
Successfully installed aws-sdk-dynamodbstreams-1.3.0
Fetching: aws-sdk-ec2-1.45.0.gem (100%)
Successfully installed aws-sdk-ec2-1.45.0
Fetching: aws-sdk-ecr-1.6.0.gem (100%)
Successfully installed aws-sdk-ecr-1.6.0
Fetching: aws-sdk-ecs-1.19.0.gem (100%)
Successfully installed aws-sdk-ecs-1.19.0
Fetching: aws-sdk-efs-1.4.0.gem (100%)
Successfully installed aws-sdk-efs-1.4.0
Fetching: aws-sdk-eks-1.4.0.gem (100%)
Successfully installed aws-sdk-eks-1.4.0
Fetching: aws-sdk-emr-1.5.0.gem (100%)
Successfully installed aws-sdk-emr-1.5.0
Fetching: aws-sdk-elasticache-1.6.0.gem (100%)
Successfully installed aws-sdk-elasticache-1.6.0
Fetching: aws-sdk-elasticbeanstalk-1.11.0.gem (100%)
Successfully installed aws-sdk-elasticbeanstalk-1.11.0
Fetching: aws-sdk-elasticloadbalancing-1.5.0.gem (100%)
Successfully installed aws-sdk-elasticloadbalancing-1.5.0
Fetching: aws-sdk-elasticloadbalancingv2-1.14.0.gem (100%)
Successfully installed aws-sdk-elasticloadbalancingv2-1.14.0
Fetching: aws-sdk-elastictranscoder-1.3.0.gem (100%)
Successfully installed aws-sdk-elastictranscoder-1.3.0
Fetching: aws-sdk-elasticsearchservice-1.10.0.gem (100%)
Successfully installed aws-sdk-elasticsearchservice-1.10.0
Fetching: aws-sdk-fms-1.3.0.gem (100%)
Successfully installed aws-sdk-fms-1.3.0
Fetching: aws-sdk-firehose-1.6.0.gem (100%)
Successfully installed aws-sdk-firehose-1.6.0
Fetching: aws-sdk-gamelift-1.7.0.gem (100%)
Successfully installed aws-sdk-gamelift-1.7.0
Fetching: aws-sdk-glacier-1.11.0.gem (100%)
Successfully installed aws-sdk-glacier-1.11.0
Fetching: aws-sdk-glue-1.16.0.gem (100%)
Successfully installed aws-sdk-glue-1.16.0
Fetching: aws-sdk-greengrass-1.7.0.gem (100%)
Successfully installed aws-sdk-greengrass-1.7.0
Fetching: aws-sdk-guardduty-1.7.0.gem (100%)
Successfully installed aws-sdk-guardduty-1.7.0
Fetching: aws-sdk-health-1.5.0.gem (100%)
Successfully installed aws-sdk-health-1.5.0
Fetching: aws-sdk-iam-1.8.0.gem (100%)
Successfully installed aws-sdk-iam-1.8.0
Fetching: aws-sigv2-1.0.1.gem (100%)
Successfully installed aws-sigv2-1.0.1
Fetching: aws-sdk-importexport-1.3.0.gem (100%)
Successfully installed aws-sdk-importexport-1.3.0
Fetching: aws-sdk-inspector-1.8.0.gem (100%)
Successfully installed aws-sdk-inspector-1.8.0
Fetching: aws-sdk-iot-1.15.0.gem (100%)
Successfully installed aws-sdk-iot-1.15.0
Fetching: aws-sdk-iot1clickdevicesservice-1.3.0.gem (100%)
Successfully installed aws-sdk-iot1clickdevicesservice-1.3.0
Fetching: aws-sdk-iot1clickprojects-1.3.0.gem (100%)
Successfully installed aws-sdk-iot1clickprojects-1.3.0
Fetching: aws-sdk-iotanalytics-1.7.0.gem (100%)
Successfully installed aws-sdk-iotanalytics-1.7.0
Fetching: aws-sdk-iotdataplane-1.3.0.gem (100%)
Successfully installed aws-sdk-iotdataplane-1.3.0
Fetching: aws-sdk-iotjobsdataplane-1.3.0.gem (100%)
Successfully installed aws-sdk-iotjobsdataplane-1.3.0
Fetching: aws-sdk-kms-1.9.0.gem (100%)
Successfully installed aws-sdk-kms-1.9.0
Fetching: aws-sdk-kinesis-1.6.0.gem (100%)
Successfully installed aws-sdk-kinesis-1.6.0
Fetching: aws-sdk-kinesisanalytics-1.5.0.gem (100%)
Successfully installed aws-sdk-kinesisanalytics-1.5.0
Fetching: aws-sdk-kinesisvideo-1.4.0.gem (100%)
Successfully installed aws-sdk-kinesisvideo-1.4.0
Fetching: aws-sdk-kinesisvideoarchivedmedia-1.4.0.gem (100%)
Successfully installed aws-sdk-kinesisvideoarchivedmedia-1.4.0
Fetching: aws-sdk-kinesisvideomedia-1.3.0.gem (100%)
Successfully installed aws-sdk-kinesisvideomedia-1.3.0
Fetching: aws-sdk-lambda-1.10.0.gem (100%)
Successfully installed aws-sdk-lambda-1.10.0
Fetching: aws-sdk-lambdapreview-1.3.0.gem (100%)
Successfully installed aws-sdk-lambdapreview-1.3.0
Fetching: aws-sdk-lex-1.6.0.gem (100%)
Successfully installed aws-sdk-lex-1.6.0
Fetching: aws-sdk-lexmodelbuildingservice-1.9.0.gem (100%)
Successfully installed aws-sdk-lexmodelbuildingservice-1.9.0
Fetching: aws-sdk-lightsail-1.7.0.gem (100%)
Successfully installed aws-sdk-lightsail-1.7.0
Fetching: aws-sdk-mq-1.4.0.gem (100%)
Successfully installed aws-sdk-mq-1.4.0
Fetching: aws-sdk-mturk-1.6.0.gem (100%)
Successfully installed aws-sdk-mturk-1.6.0
Fetching: aws-sdk-machinelearning-1.3.0.gem (100%)
Successfully installed aws-sdk-machinelearning-1.3.0
Fetching: aws-sdk-macie-1.3.0.gem (100%)
Successfully installed aws-sdk-macie-1.3.0
Fetching: aws-sdk-marketplacecommerceanalytics-1.3.0.gem (100%)
Successfully installed aws-sdk-marketplacecommerceanalytics-1.3.0
Fetching: aws-sdk-marketplaceentitlementservice-1.3.0.gem (100%)
Successfully installed aws-sdk-marketplaceentitlementservice-1.3.0
Fetching: aws-sdk-marketplacemetering-1.3.0.gem (100%)
Successfully installed aws-sdk-marketplacemetering-1.3.0
Fetching: aws-sdk-mediaconvert-1.12.0.gem (100%)
Successfully installed aws-sdk-mediaconvert-1.12.0
Fetching: aws-sdk-medialive-1.11.0.gem (100%)
Successfully installed aws-sdk-medialive-1.11.0
Fetching: aws-sdk-mediapackage-1.6.0.gem (100%)
Successfully installed aws-sdk-mediapackage-1.6.0
Fetching: aws-sdk-mediastore-1.4.0.gem (100%)
Successfully installed aws-sdk-mediastore-1.4.0
Fetching: aws-sdk-mediastoredata-1.4.0.gem (100%)
Successfully installed aws-sdk-mediastoredata-1.4.0
Fetching: aws-sdk-mediatailor-1.4.0.gem (100%)
Successfully installed aws-sdk-mediatailor-1.4.0
Fetching: aws-sdk-migrationhub-1.5.0.gem (100%)
Successfully installed aws-sdk-migrationhub-1.5.0
Fetching: aws-sdk-mobile-1.3.0.gem (100%)
Successfully installed aws-sdk-mobile-1.3.0
Fetching: aws-sdk-neptune-1.4.0.gem (100%)
Successfully installed aws-sdk-neptune-1.4.0
Fetching: aws-sdk-opsworks-1.6.0.gem (100%)
Successfully installed aws-sdk-opsworks-1.6.0
Fetching: aws-sdk-opsworkscm-1.5.0.gem (100%)
Successfully installed aws-sdk-opsworkscm-1.5.0
Fetching: aws-sdk-organizations-1.12.0.gem (100%)
Successfully installed aws-sdk-organizations-1.12.0
Fetching: aws-sdk-pi-1.3.0.gem (100%)
Successfully installed aws-sdk-pi-1.3.0
Fetching: aws-sdk-pinpoint-1.9.0.gem (100%)
Successfully installed aws-sdk-pinpoint-1.9.0
Fetching: aws-sdk-polly-1.10.0.gem (100%)
Successfully installed aws-sdk-polly-1.10.0
Fetching: aws-sdk-pricing-1.3.0.gem (100%)
Successfully installed aws-sdk-pricing-1.3.0
Fetching: aws-sdk-rds-1.29.0.gem (100%)
Successfully installed aws-sdk-rds-1.29.0
Fetching: aws-sdk-redshift-1.10.0.gem (100%)
Successfully installed aws-sdk-redshift-1.10.0
Fetching: aws-sdk-rekognition-1.9.0.gem (100%)
Successfully installed aws-sdk-rekognition-1.9.0
Fetching: aws-sdk-resourcegroups-1.4.0.gem (100%)
Successfully installed aws-sdk-resourcegroups-1.4.0
Fetching: aws-sdk-resourcegroupstaggingapi-1.3.0.gem (100%)
Successfully installed aws-sdk-resourcegroupstaggingapi-1.3.0
Fetching: aws-sdk-route53-1.12.0.gem (100%)
Successfully installed aws-sdk-route53-1.12.0
Fetching: aws-sdk-route53domains-1.5.0.gem (100%)
Successfully installed aws-sdk-route53domains-1.5.0
Fetching: aws-sdk-s3-1.19.0.gem (100%)
Successfully installed aws-sdk-s3-1.19.0
Fetching: aws-sdk-ses-1.10.0.gem (100%)
Successfully installed aws-sdk-ses-1.10.0
Fetching: aws-sdk-sms-1.3.0.gem (100%)
Successfully installed aws-sdk-sms-1.3.0
Fetching: aws-sdk-sns-1.5.0.gem (100%)
Successfully installed aws-sdk-sns-1.5.0
Fetching: aws-sdk-sqs-1.6.0.gem (100%)
Successfully installed aws-sdk-sqs-1.6.0
Fetching: aws-sdk-ssm-1.25.0.gem (100%)
Successfully installed aws-sdk-ssm-1.25.0
Fetching: aws-sdk-swf-1.3.0.gem (100%)
Successfully installed aws-sdk-swf-1.3.0
Fetching: aws-sdk-sagemaker-1.18.0.gem (100%)
Successfully installed aws-sdk-sagemaker-1.18.0
Fetching: aws-sdk-sagemakerruntime-1.4.0.gem (100%)
Successfully installed aws-sdk-sagemakerruntime-1.4.0
Fetching: aws-sdk-secretsmanager-1.14.0.gem (100%)
Successfully installed aws-sdk-secretsmanager-1.14.0
Fetching: aws-sdk-serverlessapplicationrepository-1.6.0.gem (100%)
Successfully installed aws-sdk-serverlessapplicationrepository-1.6.0
Fetching: aws-sdk-servicecatalog-1.8.0.gem (100%)
Successfully installed aws-sdk-servicecatalog-1.8.0
Fetching: aws-sdk-servicediscovery-1.5.0.gem (100%)
Successfully installed aws-sdk-servicediscovery-1.5.0
Fetching: aws-sdk-shield-1.5.0.gem (100%)
Successfully installed aws-sdk-shield-1.5.0
Fetching: aws-sdk-signer-1.2.0.gem (100%)
Successfully installed aws-sdk-signer-1.2.0
Fetching: aws-sdk-simpledb-1.3.0.gem (100%)
Successfully installed aws-sdk-simpledb-1.3.0
Fetching: aws-sdk-snowball-1.7.0.gem (100%)
Successfully installed aws-sdk-snowball-1.7.0
Fetching: aws-sdk-states-1.5.0.gem (100%)
Successfully installed aws-sdk-states-1.5.0
Fetching: aws-sdk-storagegateway-1.9.0.gem (100%)
Successfully installed aws-sdk-storagegateway-1.9.0
Fetching: aws-sdk-support-1.3.0.gem (100%)
Successfully installed aws-sdk-support-1.3.0
Fetching: aws-sdk-transcribeservice-1.6.0.gem (100%)
Successfully installed aws-sdk-transcribeservice-1.6.0
Fetching: aws-sdk-translate-1.4.0.gem (100%)
Successfully installed aws-sdk-translate-1.4.0
Fetching: aws-sdk-waf-1.8.0.gem (100%)
Successfully installed aws-sdk-waf-1.8.0
Fetching: aws-sdk-wafregional-1.8.0.gem (100%)
Successfully installed aws-sdk-wafregional-1.8.0
Fetching: aws-sdk-workdocs-1.4.0.gem (100%)
Successfully installed aws-sdk-workdocs-1.4.0
Fetching: aws-sdk-workmail-1.4.0.gem (100%)
Successfully installed aws-sdk-workmail-1.4.0
Fetching: aws-sdk-workspaces-1.5.0.gem (100%)
Successfully installed aws-sdk-workspaces-1.5.0
Fetching: aws-sdk-xray-1.6.0.gem (100%)
Successfully installed aws-sdk-xray-1.6.0
Fetching: aws-sdk-resources-3.25.0.gem (100%)
Successfully installed aws-sdk-resources-3.25.0
Fetching: aws-sdk-3.0.1.gem (100%)
Successfully installed aws-sdk-3.0.1
Fetching: aws-sdk-v1-1.66.0.gem (100%)
Successfully installed aws-sdk-v1-1.66.0
Fetching: erubis-2.7.0.gem (100%)
Successfully installed erubis-2.7.0
Fetching: builder-3.2.3.gem (100%)
Successfully installed builder-3.2.3
Fetching: excon-0.62.0.gem (100%)
Successfully installed excon-0.62.0
Fetching: formatador-0.2.5.gem (100%)
Successfully installed formatador-0.2.5
Fetching: fog-core-1.43.0.gem (100%)
Successfully installed fog-core-1.43.0
Fetching: multi_json-1.13.1.gem (100%)
Successfully installed multi_json-1.13.1
Fetching: fog-json-1.2.0.gem (100%)
Successfully installed fog-json-1.2.0
Fetching: fog-xml-0.1.3.gem (100%)
Successfully installed fog-xml-0.1.3
Fetching: ipaddress-0.8.3.gem (100%)
Successfully installed ipaddress-0.8.3
Fetching: fog-atmos-0.1.0.gem (100%)
Successfully installed fog-atmos-0.1.0
Fetching: fog-aws-2.0.1.gem (100%)
Successfully installed fog-aws-2.0.1
Fetching: dry-inflector-0.1.2.gem (100%)
Successfully installed dry-inflector-0.1.2
Fetching: mime-types-2.99.3.gem (100%)
Successfully installed mime-types-2.99.3
Fetching: fog-brightbox-0.16.1.gem (100%)
Successfully installed fog-brightbox-0.16.1
Fetching: fog-ecloud-0.1.1.gem (100%)
Successfully installed fog-ecloud-0.1.1
Fetching: fog-google-0.6.0.gem (100%)
Successfully installed fog-google-0.6.0
Fetching: fog-local-0.5.0.gem (100%)
Successfully installed fog-local-0.5.0
Fetching: fog-powerdns-0.2.0.gem (100%)
Successfully installed fog-powerdns-0.2.0
Fetching: fog-profitbricks-4.1.1.gem (100%)
Successfully installed fog-profitbricks-4.1.1
Fetching: fog-radosgw-0.0.5.gem (100%)
Successfully installed fog-radosgw-0.0.5
Fetching: fog-riakcs-0.1.0.gem (100%)
Successfully installed fog-riakcs-0.1.0
Fetching: fog-sakuracloud-1.7.5.gem (100%)
Successfully installed fog-sakuracloud-1.7.5
Fetching: fog-serverlove-0.1.2.gem (100%)
Successfully installed fog-serverlove-0.1.2
Fetching: fog-softlayer-1.1.4.gem (100%)
Successfully installed fog-softlayer-1.1.4
Fetching: fog-storm_on_demand-0.1.1.gem (100%)
Successfully installed fog-storm_on_demand-0.1.1
Fetching: fog-terremark-0.1.0.gem (100%)
Successfully installed fog-terremark-0.1.0
Fetching: CFPropertyList-2.3.6.gem (100%)
Successfully installed CFPropertyList-2.3.6
Fetching: fission-0.5.0.gem (100%)
Successfully installed fission-0.5.0
Fetching: fog-vmfusion-0.1.0.gem (100%)
Successfully installed fog-vmfusion-0.1.0
Fetching: fog-voxel-0.1.0.gem (100%)
Successfully installed fog-voxel-0.1.0
Fetching: fog-1.32.0.gem (100%)
Successfully installed fog-1.32.0
Fetching: unf-0.1.4.gem (100%)
Successfully installed unf-0.1.4
Fetching: domain_name-0.5.20180417.gem (100%)
Successfully installed domain_name-0.5.20180417
Fetching: http-cookie-1.0.3.gem (100%)
Successfully installed http-cookie-1.0.3
Fetching: netrc-0.11.0.gem (100%)
Successfully installed netrc-0.11.0
Fetching: rest-client-1.8.0.gem (100%)
Successfully installed rest-client-1.8.0
Fetching: right_http_connection-1.5.0.gem (100%)
Successfully installed right_http_connection-1.5.0
Fetching: right_aws-3.1.0.gem (100%)
Successfully installed right_aws-3.1.0
Fetching: sensu-plugins-aws-12.1.0.gem (100%)
You can use the embedded Ruby by setting EMBEDDED_RUBY=true in /etc/default/sensu
Successfully installed sensu-plugins-aws-12.1.0
193 gems installed
[SENSU-INSTALL] successfully installed Sensu plugins: ["sensu-plugins-aws"]
[root@88c43b3d21a8 /]# date
Fri Sep  7 17:42:56 UTC 2018
[root@88c43b3d21a8 /]#

[majormoses]

What kind of resources does your CI system have? On my laptop It takes a little more than a minute even with compilation: https://gist.github.com/majormoses/871cd3dbad9639b66813d5427b4d00a0

My laptop has 16GB of RAM and a Intel(R) Core(TM) i7-7600U CPU @ 2.80GHz I can run some tests with more limited resources if I know the profile.

[majormoses]

I attempted to replicate again restricting the docker container to a single CPU and 512m of RAM and saw about the same time.

[majormoses]

During the CI build is there any indicator which resources are potentially a bottleneck? I would check:

• CPU
• Memory
• Disk IO
• Network IO

[multani]

It seems there's a problem with the latest versions of the aws-sdk gem and Rubygems, that makes installing the Sensu plugin verrrryyyy slow also for me.

[majormoses]

Hmm I will have to look into it more this weekend and try to reproduce this.

[robert-put]

Installing on t3.mediums in AWS took ~15 mins on average. Tested on 3 different Centos 7 instances

[majormoses]

Interesting I will try it on an aws instance some time next week at work to see if its different but again locally I can not reproduce any install failures or installs that take more than 2 minutes, I tested this in and outside of docker. I read through the upstream issues and rubygems has no intention of solving it at this time and the aws gem maintainers suggest something that is not exactly trivial or convenient for this use case. The recommendation is to only require the components you need rather than aws-sdk which includes everything. Trying to figure out what each script needs will be a non trivial task and will likely result in several broken builds (bug reports) but that is the only suggestion that seems to make sense and could have an impact. If someone would like to start working on that and can show a meaningful improvement I am open to a change.

@robert-put in the case of aws t[1-3].* instances they have in my experience suffered from poor performance due to lack of CPU credits and noisy neighbors, can you replicate on say an m[4-5].* instance? I am trying to understand if there is some kind of threshold where under a certain amount of cpu, ram, network, etc surface the issue or at least more clearly.

[majormoses]

Was finally able to reproduce it in vagrant: https://gist.github.com/majormoses/871cd3dbad9639b66813d5427b4d00a0#file-timed-logs-install-aws-plugin-vagrant-txt using 1 GB and 1 core, I will try to see if above some threshold it becomes a quick install as I see locally on my machine. Apologies in advance as I will be traveling for work this week and may not respond in a timely manner.

[majormoses]

I doubt it will make it much better but we did finally remove the aws-sdk-v1 gem from our dependencies. Use version 16.0.0 to test.

[hprins]

Is there any update on this? Installation is still very slow using latest version. Thanks for assisting.

[majormoses]

I have so far only been able to replicate this on servers with very few resources and I only install this plugin on a handful of servers so I have not had a personal need to work on this. Essentially what we need to do is rather than pull in all of aws-sdk we need to pull in specific portions of it to reduce the number of dependencies during install. This will be something that will need a lot of help testing as it has a very high risk of accidentally leaving something out. We do have some test coverage but I am not confident that we have enough to where we can rely solely on automated testing. If someone wants to start taking a crack at it I am all for it I just don't have the bandwidth myself to undertake this.

[cdenneen]

Similar to the compiling of nokogiri and unf_ext, is there anything that can be done to speed up the aws-sdk? We’ve seen instances like t2.medium do puppet installs of sensu and plugins including this one and from time to time get OOM errors. Building native extensions. This could take a while... ERROR: Error installing sensu-plugins-aws: ERROR: Failed to build gem native extension. current directory: /opt/sensu/embedded/lib/ruby/gems/2.4.0/gems/nokogiri-1.8.5/ext/nokogiri /opt/sensu/embedded/bin/ruby -r ./siteconf20181119-26141-tabkmz.rb extconf.rb Cannot allocate memory - /opt/sensu/embedded/bin/ruby -r ./siteconf20181119-26141-tabkmz.rb extconf.rb 2>&1

…

On Wed, Nov 21, 2018 at 1:20 AM Ben Abrams ***@***.***> wrote: I have so far only been able to replicate this on servers with very few resources and I only install this plugin on a handful of servers so I have not had a personal need to work on this. Essentially what we need to do is rather than pull in all of aws-sdk we need to pull in specific portions of it to reduce the number of dependencies during install. This will be something that will need a lot of help testing as it has a very high risk of accidentally leaving something out. We do have some test coverage but I am not confident that we have enough to where we can rely solely on automated testing. If someone wants to start taking a crack at it I am all for it I just don't have the bandwidth myself to undertake this. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#293 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAr84V5h3OFKKFyM15twbzOc01U80HMiks5uxPCwgaJpZM4WfOZ_> .