Ask Your Question
0

Puppet master not compiling catalogs until restarted

asked 2014-06-03 13:09:52 -0600

Merch gravatar image

updated 2014-06-03 13:10:21 -0600

Once every day or so my Puppet Master will start erroring every time a node attempts to fetch a catalog. Restarting the puppet master process resolves this.

Error:

Could not retrieve catalog from remote server: Error 400 on SERVER: No such file or directory - getcwd at /etc/puppet/modules/ntp/manifests/config.pp:21 on node foo.com

Puppet 3.5.1 CentOS 6.5 Ruby 1.8.7

Any ideas what might be causing this?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2014-06-03 18:14:49 -0600

Stefan gravatar image

Well it seems that the puppet master has changed to a directory that gets deleted later on. As a result the current working directory (cwd) of the process returns a nonexistant directory.

When the error arrives the next time, please run ls -l /proc/${PID_OF_PUPPET_MASTER}/cwd This should return the current working directory of the process and might give some clues.

edit flag offensive delete link more

Comments

Thanks, I'll do that and post an update.

Merch gravatar imageMerch ( 2014-06-03 18:46:33 -0600 )edit

@Stefan Result: /proc/25899/cwd -> /biz/puppet/modules/mush_network_access/files (deleted) Though the path does exist and I'm almost certain it is never deleted and re-created so I'm not sure what is the issue is. [root@puppet-master puppet-skeleton]# ll /biz/puppet/modules/mush_network_access/files/ total 12

Merch gravatar imageMerch ( 2014-06-09 11:36:45 -0600 )edit

the first ls output tells you exactly that: The working directory does no longer exist. If you can see the directory in the file system than it is a different one. Run `ls -lid /proc/25899/cwd/` and you will see the inode number in the first column. Now run the same command against the directory on the filesystem.

Stefan gravatar imageStefan ( 2014-06-19 17:52:35 -0600 )edit

The id's are indeed different. No how or why that would happen, I'll have to investigate. Thanks for the assistance.

Merch gravatar imageMerch ( 2014-06-23 11:04:32 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

1 follower

Stats

Asked: 2014-06-03 13:09:52 -0600

Seen: 409 times

Last updated: Jun 03 '14