Ask Your Question
0

puppetlabs-aws: Infrequent Error: Failed to apply catalog: execution expired

asked 2016-03-07 15:57:09 -0500

theillien gravatar image

I have a PE Master in AWS which uses the puppetlabs-aws module. I have created a user with admin privileges (to be pared down, eventually) for use speicifically for performing Puppet actions on our AWS environment; Creating Instances, routes, DNS entries, etc.

Every now and then an action times out and throws the error in the subject. Ex.:

# puppet apply --noop --verbose /etc/puppetlabs/code/environments/production/modules/aws_prod/manifests/init.pp 
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Notice: Compiled catalog for puppetmaster.cspops.int in environment production in 0.07 seconds
Info: Applying configuration version '1457384334'
Error: Failed to apply catalog: execution expired

Sometimes this happens each run. Other times it will actually go through and will continue to do so for a brief period of time.

# puppet apply --noop --verbose 
/etc/puppetlabs/code/environments/production/modules/aws_prod/manifests/init.pp 
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Notice: Compiled catalog for puppetmaster.cspops.int in environment production in 0.07 seconds
Info: Applying configuration version '1457384457'
Notice: /Stage[main]/Main/Ec2_instance[puppet_prov_test]/ensure: current_value absent, should be present (noop)
Notice: Class[Main]: Would have triggered 'refresh' from 1 events
Notice: Stage[main]: Would have triggered 'refresh' from 1 events
Notice: Applied catalog in 11.04 seconds

# puppet apply --verbose /etc/puppetlabs/code/environments/production/modules/aws_prod/manifests/init.pp 
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Info: Loading facts
Notice: Compiled catalog for puppetmaster.cspops.int in environment production in 0.07 seconds
Info: Applying configuration version '1457384482'
Info: Checking if instance puppet_prov_test is running in region us-east-1
Info: Checking if instance puppet_prov_test is stopped in region us-east-1
Info: Starting instance puppet_prov_test in region us-east-1
Notice: /Stage[main]/Main/Ec2_instance[puppet_prov_test]/ensure: changed absent to running
Notice: Applied catalog in 11.47 seconds

I understand this is likely something on the AWS side, but the error is from the module and doesn't give any further indication as to which direction the troubleshooting should go. Additionally, I never experience this issue when using the AWS CLI. I've looked for auth logs in AWS but have not been able to find anything.

Has anyone else dealt with this and have something that might shed some light on why this intermittently breaks?

edit retag flag offensive close merge delete

2 answers

Sort by ยป oldest newest most voted
1

answered 2016-03-08 18:11:08 -0500

theillien gravatar image

Solution is in the module documentation:

edit flag offensive delete link more
0

answered 2016-03-08 11:04:00 -0500

Nizen gravatar image

As far as I know, there could be a few reasons for this. Do you have a lot of servers running on the same puppet master? Have you checked the load on the master?

edit flag offensive delete link more

Comments

The solution to my problem is in the module documentation.

theillien gravatar imagetheillien ( 2016-03-09 14:39:26 -0500 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

2 followers

Stats

Asked: 2016-03-07 15:57:09 -0500

Seen: 234 times

Last updated: Mar 08 '16