Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Each pipeline is currently hosted here infant-nutrition-project/jenkins-pipelines in the for of three separate Jenkinsfiles which specify the main behavior of the pipelines. In case anything goes wrong you


Troubleshooting

The first step to diagnose issues with the Jenkins server itself is to ssh into the Jenkins EC2 instance and run the following command:

Code Block
$ sudo systemctl status jenkins

It should say Active: active (running). If you see some other status besides that you need to restart the server with the following command:

Code Block
$ sudo systemctl restart jenkins


If you find Jenkins often changes status to Active: active (exited) that is probably due to the out of memory killer killing the Jenkins process. We believed we had the issue resolved at the point of writing, but if it comes up in the future consider cloning the EC2 instance to a machine with more memory or else just scheduling restarts of Jenkins at regular intervals. Alternatively if you can figure out how to reduce JVM memory usage that could also solve the problem.

For other issues with the Jenkins server itself consider making sure its SSL cert is not expired or checking the status of the nginx server.


If Jenkins is up and running and anything goes wrong with a build you should consult the errors either sent to the email or stored in the failed job report in Jenkins. You can find this by navigating to jenkins.diaper.cf and signing in with the username and password stored in the Cornell Box and clicking on the relevant job.