##Trusted Firmware CI Infrastructure Project - Phase 2
###Project Milestones & Status
<table>
<tr> <th>Milestone</th> <th>Deliverables</th><th>Target Completion</th><th>Status</th></tr>
<tr>
<td>M1</td>
<td>**Planning, Handover and Deployment**
{icon check-circle color=green} SOW and project plan
{icon check-circle color=green} Hand over from OCE to Developer Services
</td>
<td> 1-Jun-20 </td>
<td> Completed
Project Plan & SoW Reviewed. Meetings have been held and follow on meetings will occur as normal course of the project
</td>
</tr>
<tr>
<td>M2</td>
<td>**FVP Support (TF-M ID3, TF-A ID26)**
{icon cogs color=blue} FVP models running CI jobs ([[https://projects.linaro.org/browse/LSS-1393 | LSS-1393]], {icon handshake-o color=red} [[https://review.trustedfirmware.org/c/ci/tf-a-ci-scripts/+/5180|tf-a-ci-scripts/+/5180]])
**Staging Scripts (TF-M ID7, TF-A ID7)**
{icon cogs color=blue} A staging version of the scripts created on the production instance ([[https://projects.linaro.org/browse/LSS-1430 | LSS-1430]])
**Job configuration**
{icon minus-circle color=red} Ability to build multiple configurations of TF-A (TF-A ID9, {icon handshake-o color=red} [[https://review.trustedfirmware.org/c/ci/tf-a-job-configs/+/4917|tf-a-job-configs/4917]])
{icon minus-circle color=red} Provide a way to re-trigger the jobs manually (TF-A ID3, {icon handshake-o color=red} [[https://projects.linaro.org/browse/LSS-1470|LSS-1470]])
{icon minus-circle color=red} Ability to specify at run time that a CI job should keep all artifacts indefinitely. (TF-A ID22 [[https://projects.linaro.org/browse/LSS-1485|LSS-1485]])
** TF-A Static Analysis Integration (TF-A ID17, TF-A ID19)**
{icon minus-circle color=red} Arm check scripts ({icon handshake-o color=red} [[https://review.trustedfirmware.org/c/ci/tf-a-job-configs/+/4938|tf-a-job-configs/4938]])
{icon minus-circle color=red} cppcheck ({icon handshake-o color=red} [[https://review.trustedfirmware.org/c/ci/tf-a-job-configs/+/4938|tf-a-job-configs/4938]])
{icon minus-circle color=red} Coverity Free online check ({icon handshake-o color=red} [[https://review.trustedfirmware.org/c/ci/tf-a-job-configs/+/4938|tf-a-job-configs/4938]])
**TF-M Static Analysis Integration (TF-M ID1)**
{icon
minuscheck-circle color=
red}green} Arm check scripts ([[https://review.trustedfirmware.org/c/ci/tf-m-job-configs/+/4973| tf-m-job-configs/497]], [[https://review.trustedfirmware.org/c/ci/tf-m-ci-scripts/+/4972|tf-m-ci-scripts/4972]])
{icon check-circle color=green} cppcheck
{icon minus-circle color=red} Coverity Free online check ([[https://review.trustedfirmware.org/c/ci/tf-m-ci-scripts/+/5293|tf-m-ci-scripts/5293]])
</td>
<td>TBD (new)
25-Jun-20 (orig)</td>
<td>
{icon handshake-o color=red} Blocked - Awaiting CR approval
</td>
</tr>
<tr>
<td>M3 & M4</td>
<td>**TF-A Tests**
{icon minus-circle color=red} Create CI loop for TF-A Tests (TF-A ID2, {icon handshake-o color=red}[[https://review.trustedfirmware.org/c/ci/tf-a-job-configs/+/4873|tf-a-job-configs/4873]])
{icon minus-circle color=red} Ability to build multiple configurations of TF-A Tests (TF-A ID12, {icon handshake-o color=red} [[https://review.trustedfirmware.org/c/ci/tf-a-job-configs/+/4917|tf-a-job-configs/4917]])
{icon check-circle color=green} CI results for TF-A and TF-TF must stay available for a minimum duration (eg. 1 week) (TF-A ID21)
{icon cogs color=blue} Run TF-TF tests "bare metal" on FVP (TF-A ID24, {icon minus-circle color=red} [[https://review.trustedfirmware.org/c/ci/tf-a-ci-scripts/+/5180|tf-a-ci-scripts/+/5180]])
**Test Levels**
{icon cogs color=blue} Provide facility for a job to pass the "level" of testing required, eg. minimal, full, etc., where different tests are executed depending on the level passed into (TF-M ID10, TF-A ID31)
</td>
<td>TBD (new)
23-Jul-20 (orig)</td>
<td>
{icon handshake-o color=red} Blocked - Awaiting CR approval
</td>
</tr>
<tr>
<td>M5</td>
<td>**Specify FVP Versions (TF-A ID13)**
{icon minus-circle color=red} Update FVP support to host multiple versions of models
{icon minus-circle color=red} Allow jobs to specify which version of FVP models are used
**Compilers accessed via volumes mounted in the docker containers** ([[https://review.trustedfirmware.org/c/ci/dockerfiles/+/5454|dockerfiles/+/5454]])
- Ability to integrate alternative compilers into builds (TF-M ID9, TF-A ID10)
- Ability to use different versions of a compiler for builds (TF-A ID11)
- Integrate one alternative compiler and have two versions of the standard Arm GCC compiler to demonstrate how the functionality works. Compilers should be secure, preventing users from accessing them directly, and should only be used for building TF CI jobs
</td>
<td>TBD
5-Aug-20(orig)</td>
<td> Blocked
Awaiting M2 </td>
</tr>
<tr>
<td>M6, M7 & M8</td>
<td> **Musca A/B1 Support (TF-M ID5)**
{icon cogs color=blue} Musca B1 board installed in Linaro Cambridge LAVA lab.
{icon cogs color=blue} Musca B1 board support integrated into the CI loop.
([[https://projects.linaro.org/browse/LSS-1414|LSS-1414]])
**Dashboard configured in SQUAD instance (TF-M ID2, TF-A ID32)**
- Metrics and test results from LAVA jobs visible in the SQUAD dashboard
**Deploy HTML Reports (TF-A ID23)**
{icon check-circle color=green} Deliver ongoing Linaro internal work to produce HTML reports from SQUAD data
**Boot Results passed to Gerrit (No ID)**
- Use the LAVA notification service to pass boot results back to the review that triggered the job(s)
**QEMU Support (TF-M ID4)**
- Integrate the QEMU SSE-200 v8m machine into the CI loop.
</td>
<td>21-Aug-20</td>
<td>In Progress
Received healthcheck binaries
Musca A removed and S1 on hold for Phase 3 (per 7/2 Meeting).
QEMU SSE-200 device type now active in LAVA.
</td>
</tr>
<tr>
<td>M9</td>
<td>**Integrate PSA compliance tests (TF-M ID6)**
- Provide a build option to run PSA API tests
- Ensures patches will not break PSA compliance
</td>
<td>24-Aug-20</td>
<td></td>
</tr>
<tr>
<td>M10</td>
<td>**Modularise Build and Test Process**
- Remove all configuration out of the scripts and into the YAML provided to control the job. (TF-M ID14)
- Allow the user to trigger a job with default, custom or release parameters. This gives limited permissions to the user to create jobs. (TF-M ID18)
</td>
<td>10-Sep-20</td>
<td></td>
</tr>
<tr>
<td>M11</td>
<td>**Documentation and User Guide (TF-M ID8)**
- How to use the complete CI loop
- How to integrate a new platform, including boards in a LAVA Federated lab
- How to deploy your own instance
</td>
<td>29-Sep-20</td>
<td></td>
</tr>
</table>
<table>
<tr>
<td>Completed {icon check-circle color=green} </td>
<td>In Progress {icon cogs color=blue} </td>
<td>Blocked {icon minus-circle color=red} </td>
</tr>
</table>
###How to submit LSS tickets to Linaro
1) Go to https://projects.linaro.org/secure/CreateIssue!default.jspa
2) Fill in the drop down boxes:
- Project: LAB & System Software (LSS)
- Issue Type: Ticket
- Click Next
3) Fill in the required details
- Summary: You should fill in the "Summary" with a snappy title. I've started to prefix my titles with "TF CI: " to help identify them in the list of issues.
- Components: "Systems (Bugzilla, Git, Gerrit, Jenkins)"
- Client Stakeholder: "Trusted-Firmware"
4) Fill in the issue Description
- You will need to fill in the Description, even if you think the title is sufficient. Provide enough overview detail so the issue is clear to understand by management, but make sure you include all the technical details you need for the support engineer to reproduce and resolve your problem.
5) Click the "Create" button at the bottom of the page
6) Add Watchers
- It's probably a good idea to add Bill Fletcher and Ryan Harkin to the Watchers on the ticket.
If you are unable to create a ticket or have issues, you may need Jira access setup. Please contact: Glen (glen.valante@linaro.org) or Bill (bill.fletcher@linaro.org) or Ryan (ryan.harkin@linaro.org)