Continuous Integration (CI) allows developers to run different type of validation processes automatically at commit / merge time, in order to identify problems earlier and offload developers with manual processes to update collateral resources, like test results, documentation, binaries and metrics; each .  As a result, configuring CI is inherently language and eco-system needs a specific configuration.

Travis CI

...

1. Sign in to Travis CI with your Github credentials
2. Access the Travis CI profile and sync your project
3. Drop a .travis.yml file in the root folder of your github GitHub repo (check this .travis.yml as example)
   1. (optional) If you need to perform variable encryption and other useful commands, install the Travis CI Client (using gem install travis)
4. Access https://travis-ci.org/symphonyoss<program name>/<repository-name> and validate the build

...

A badge can be added at the top of the project's root-level README.md file, using the following Markdown syntax:

[![Build Status](https://travis-ci.org/symphonyoss/symphony-java-sample-bots<program name>/<repository name>.svg)](https://travis-ci.org/symphonyoss/symphony-java-sample-bots<program name>/<repository name>)

Continuous (artifact) deployment in Java

...

1. Follow the Java Snapshot deployment configuration ; as a result, you should have username/password credentials (mentioned below as CI_DEPLOY_USERNAME and CI_DEPLOY_PASSWORD) to access issues.sonatype.org

2. Open an ODP Enable CI issue to grant Raise a HELP issue or send an email to help@finos.org to request permission to deploy artifacts having groupId org.symphonyoss on Maven remote repositories; this action is not required if the user developer has already been granted access previously

3. Commit a settings.xml file in the project root folder

   Code Block
   language xml title settings.xml for snapshot deploy linenumbers true collapse true
   <settings xmlns="http://maven.apache.org/SETTINGS/1.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/SETTINGS/1.0.0 http://maven.apache.org/xsd/settings-1.0.0.xsd"> <servers> <server> <id>ossrh</id> <username>${env.CI_DEPLOY_USERNAME}</username> <password>${env.CI_DEPLOY_PASSWORD}</password> </server> </servers> </settings>

   
   

4. Define CI_DEPLOY_USERNAME and CI_DEPLOY_PASSWORD variables with Travis CI; make sure that they're encrypted and hidden during the build process; the credentials to use are the ones defined on step 1; if you don't want to share your username/password credentials, you can request and use Nexus tokens
5. Change the mvn build command to
   1. Invoke the deploy goal
   2. Append --settings settings.xml at the end of the build command

This tutorial walks through the mentioned steps, with more details and configuration options; a working example of this configuration is the symphony-java-sample-bots project.

Continuous release in Python

Travis CI can be configured to use python-semantic-release, a package that simplifies and automates versioning for python projects; a project committer can open an ODP Enable CI issue can raise a HELP issue or send an email to help@finos.org (following the template below) to request the Foundation staff to apply the proper Travis CI project settings; packages will be published on behalf of symphonyoss the Foundation's pypi user.:

h4. Project coordinates
<_githubGitHub projectrepository url and other useful info_>

h4. Previously published packages
<_Links to previously published packages on pypi.python.org (or any other publicly available repository_>

...

Travis CI can easily publish packages to npm using semantic-release.org, which delegates release operations to your CI environment and allows you to control versioning using commits (commitizen); as a result, npm packages will be continuously released on each code repository change.

Follow our instructions on how to register a package and user in the Foundation npm organisation.

Example of Configuring Integration

...

Testing

In order to run this sample (some sample bots from the Symphony program), the Travis build needs to be configured to add the following items, in order to run integration testing; please check how to request CI integration before proceeding with this configuration.:

before_script: "curl -s https://raw.githubusercontent.com/symphonyoss/contrib-toolbox/master/scripts/download-files.sh | bash"

...

At this point, the certificates are in place and downloaded into the build box; integration tests can resolve User Identity certificates by accessing environment variables.

...

The symphony-java-sample-bots is  was amongst the first project Foundation projects that was enabled to run integration tests from Travis CI; the Travis build logs (dev branch) show  for this project show two interesting items:

1. The (hidden) environment variables that identify User Identity certificates (in this case 2, one for the message sender, one for the message receiver)

   Code Block
   language bash title Travis environment variables
   Setting environment variables from repository settings $ export DOWNLOAD_PATH=[secure] $ export DOWNLOAD_ITEMS=[secure] $ export TRUSTSTORE_FILE=[secure] $ export TRUSTSTORE_PASSWORD=[secure] $ export BOT_USER_EMAIL=[secure] $ export BOT_USER_CERT_FILE=[secure] $ export SENDER_USER_EMAIL=[secure] $ export SENDER_USER_CERT_FILE=[secure] $ export DOWNLOAD_HOST=[secure] $ export SENDER_USER_CERT_PASSWORD=[secure] $ export BOT_USER_CERT_PASSWORD=[secure]

   
   

2. The integration test logs of a successful run

   Code Block
   title Maven Surefire plugin log
   ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.symphonyoss.simplebot.EchoBotIT chat initialised Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.132 sec - in org.symphonyoss.simplebot.EchoBotIT Results : Tests run: 1, Failures: 0, Errors: 0, Skipped: 0

   
   

Known

...

Certificate Issues

Caused by: javax.crypto.BadPaddingException: Given final block not properly padded at
org.symphonyoss.simplebot.EchoBotIT.sendAndReceiveEcho(EchoBotIT.java:64)

...

Myget is a friction-free continuous integration & delivery for your nuget, npm, bower and vsix packages; the Foundation provides a package repository called symphonyossrepositories, which allowsallow:

1. Pre-release build and publishing, using build environments that are equipped with .NET Framework and Visual Studio (headless); it also features source code tagging and version updates on source code based on incremental build number, to fully automate the package publishing pipeline
2. Sync with NuGet, that can be either manual (promoting pre-releases to releases using Myget MyGet web interface) or automatic ; (a committer must create a personal account on MyGet and communicate it to request access from the Foundation (see JIRA Template below) in order to be granted rights able to push feed packages)

In order to request a project to be integrated with MyGet, a project committer can sign up to MyGet and open an ODP Enable CI issue following the template below. a HELP issue or send an email to help@finos.org, using the following the template:

h4. Project coordinates
<_githubGitHub project url and other useful info_>

h4. MyGet username
<_theyour MyGet username to add permission to symphonyoss feed_>

h4. CSProj and CS files
<_Where project descriptors are located_>

h4. Packages
<_A list of the packages that are published; by default all packages are taken into account_>

h4. Publishing strategy to NuGet
<_ Whether to enable automatic publishing based on source code branching or rely on manual package pushing using the MyGet interface; if the latter, a MyGet personal account username must be provided _>

An example of project building with MyGet is the RestApiClient project in the Symphony program, which is also published on the ssf-feed MyGet repository and NuGet.

...

• Build status: 

  Code Block
  title MyGet Build Badge
  [](https://www.myget.org/feed/ssf-feed<feed name>/package/nuget/SymphonyOSS.RestApiClient<package name>)

  
  

• Latest Pre-Release package published: 

  Code Block
  title MyGet Pre-Release Badge
  [](https://www.myget.org/feed/ssf-feed<feed name>/package/nuget/SymphonyOSS.RestApiClient<package name>)

  
  

Integration testing against the Foundation

...

's Symphony Pod

A Continuous Integration environment can be integrated to run integration tests against the Foundation Symphony Pod in the Open Developer Platform, in order to provide an automated end-to-end testing process.

Requesting CI integration

Any committer can open an ODP Enable CI issue to request integrating CI with a hosted project, by providing some mandatory info, please follow the template below. a HELP issue or send an email to help@finos.org to request enabling CI on a hosted project.  Please follow this template:

h4. Project coordinates
<_githubGitHub project url and other useful info_>

h4. Integration tests
<_List and describe (what to expect, how long it takes to run, the integration tests that you want to run in a CI environment_>

h4. Local run
<_Describe how to setup a local environment and run the integration tests_>

h4. Environment variables
<_List all environment variables needed to run the integration tests_>

h4. Current environment
<_Describe the current build environment, if any_>

...