Page MenuHomePhabricator

Open CI
Updated TodayPublic

Trusted Firmware CI Infrastructure Project

Project Milestones & Status

MilestoneDeliverablesTarget CompletionStatus
M1Planning, Handover and Deployment
SOW and project plan
Hand over from OCE to Developer Services
1-Jun-20 Completed

Project Plan & SoW Reviewed. Meetings have been held and follow on meetings will occur as normal course of the project
M2FVP Support (TF-M ID3, TF-A ID26)
FVP models running CI jobs (LSS-1393, tf-a-ci-scripts/+/5180)

Staging Scripts (TF-M ID7, TF-A ID7)
A staging version of the scripts created on the production instance (LSS-1430)

Job configuration
Ability to build multiple configurations of TF-A (TF-A ID9 tf-a-job-configs/4917)
Provide a way to re-trigger the jobs manually (TF-A ID3 LSS-1470)
Ability to specify at run time that a CI job should keep all artifacts indefinitely. (TF-A ID22 LSS-1485)

TF-A Static Analysis Integration (TF-A ID17, TF-A ID19)
Arm check scripts (tf-a-job-configs/4938)
cppcheck (tf-a-job-configs/4938)
Coverity Free online check (tf-a-job-configs/4938)

TF-M Static Analysis Integration (TF-M ID1)
Arm check scripts (tf-m-job-configs/497, tf-m-ci-scripts/4972)
cppcheck
Coverity Free online check
14-Aug-20 (new)
25-Jun-20 (orig)
Blocked

Job Config/Static Analysis: Patches submitted, awaiting reviews

Awaiting internal ARM CI to OpenCI
M3 & M4TF-A Tests
Create CI loop for TF-A Tests (TF-A ID2 tf-a-job-configs/4873)
Ability to build multiple configurations of TF-A Tests (TF-A ID12 tf-a-job-configs/4917)
CI results for TF-A and TF-TF must stay available for a minimum duration (eg. 1 week) (TF-A ID21)
Run TF-TF tests "bare metal" on FVP (TF-A ID24)

Test Levels
Provide facility for a job to pass the "level" of testing required, eg. minimal, full, etc., where different tests are executed depending on the level passed into (TF-M ID10, TF-A ID31)
28-Aug-20 (new)
23-Jul-20 (orig)
Blocked
M5Specify FVP Versions (TF-A ID13)
Update FVP support to host multiple versions of models
Allow jobs to specify which version of FVP models are used

Compilers accessed via volumes mounted in the docker containers
- Ability to integrate alternative compilers into builds (TF-M ID9, TF-A ID10)
- Ability to use different versions of a compiler for builds (TF-A ID11)
- Integrate one alternative compiler and have two versions of the standard Arm GCC compiler to demonstrate how the functionality works. Compilers should be secure, preventing users from accessing them directly, and should only be used for building TF CI jobs
Needed
5-Aug-20(orig)
Blocked

Awaiting M2
M6, M7 & M8 Musca A/B1 Support (TF-M ID5)
Musca B1 board installed in Linaro Cambridge LAVA lab.
Musca B1 board support integrated into the CI loop.
(LSS-1414)

Dashboard configured in SQUAD instance (TF-M ID2, TF-A ID32)
- Metrics and test results from LAVA jobs visible in the SQUAD dashboard

Deploy HTML Reports (TF-A ID23)
Deliver ongoing Linaro internal work to produce HTML reports from SQUAD data

Boot Results passed to Gerrit (No ID)
- Use the LAVA notification service to pass boot results back to the review that triggered the job(s)

QEMU Support (TF-M ID4)
- Integrate the QEMU SSE-200 v8m machine into the CI loop.
21-Aug-20In Progress

Received healthcheck binaries

Musca A removed and S1 on hold for Phase 3 (per 7/2 Meeting).

QEMU SSE-200 device type now active in LAVA.
M9Integrate PSA compliance tests (TF-M ID6)
- Provide a build option to run PSA API tests
- Ensures patches will not break PSA compliance
24-Aug-20
M10Modularise Build and Test Process
- Remove all configuration out of the scripts and into the YAML provided to control the job. (TF-M ID14)
- Allow the user to trigger a job with default, custom or release parameters. This gives limited permissions to the user to create jobs. (TF-M ID18)
10-Sep-20
M11Documentation and User Guide (TF-M ID8)
- How to use the complete CI loop
- How to integrate a new platform, including boards in a LAVA Federated lab
- How to deploy your own instance
29-Sep-20
Completed In Progress Blocked

How to submit LSS tickets to Linaro

  1. Go to https://projects.linaro.org/secure/CreateIssue!default.jspa
  1. Fill in the drop down boxes:
    • Project: LAB & System Software (LSS)
    • Issue Type: Ticket
    • Click Next
  1. Fill in the required details
    • Summary: You should fill in the "Summary" with a snappy title. I've started to prefix my titles with "TF CI: " to help identify them in the list of issues.
    • Components: "Systems (Bugzilla, Git, Gerrit, Jenkins)"
    • Client Stakeholder: "Trusted-Firmware"
  1. Fill in the issue Description
    • You will need to fill in the Description, even if you think the title is sufficient. Provide enough overview detail so the issue is clear to understand by management, but make sure you include all the technical details you need for the support engineer to reproduce and resolve your problem.
  1. Click the "Create" button at the bottom of the page
  1. Add Watchers
    • It's probably a good idea to add Bill Fletcher and Ryan Harkin to the Watchers on the ticket.

If you are unable to create a ticket or have issues, you may need Jira access setup. Please contact: Glen (glen.valante@linaro.org) or Bill (bill.fletcher@linaro.org) or Ryan (ryan.harkin@linaro.org)

Last Author
omnium21
Last Edited
Thu, Aug 6, 8:10 AM

Event Timeline

bfletcher created this object.Jun 4 2020, 2:55 PM
gvalante edited the content of this document. (Show Details)Jun 4 2020, 5:02 PM
gvalante edited the content of this document. (Show Details)Jun 4 2020, 9:00 PM
gvalante edited the content of this document. (Show Details)Jun 10 2020, 2:25 PM
gvalante added a subscriber: gvalante.
Karl added a subscriber: Karl.Jun 11 2020, 7:50 AM
gvalante edited the content of this document. (Show Details)Jun 17 2020, 3:23 PM

Hi, for the static analysis checks, is it possible to update/increase the rules per platform? Also, is it possible to introduce more scanners for a platform?

-Varun

Hi Varun,
Yes, both are possible, but if I understand you correctly, they are out of scope for the Phase 2 project.

Hi Ryan,

I agree that this wont be part of phase 2. I just wanted to know how this would scale up for more platforms and if there is any room for platforms to increase scanners and rules.

For Tegra platforms, at least, we use CERT and CCM scanners. We also enable more MISRA rules than TF-A. I'm glad that we will have the freedom to enable them with OpenCI at some point.

-Varun

gvalante edited the content of this document. (Show Details)Jun 26 2020, 8:05 PM
gvalante edited the content of this document. (Show Details)Jun 29 2020, 8:34 PM
gvalante edited the content of this document. (Show Details)Jul 1 2020, 3:58 PM
gvalante edited the content of this document. (Show Details)Jul 1 2020, 4:09 PM
gvalante edited the content of this document. (Show Details)Jul 2 2020, 4:22 PM
gvalante edited the content of this document. (Show Details)Wed, Jul 15, 7:17 PM
gvalante edited the content of this document. (Show Details)Fri, Jul 17, 3:58 PM
lsandov1 edited the content of this document. (Show Details)Wed, Jul 29, 6:41 PM
lsandov1 edited the content of this document. (Show Details)
lsandov1 edited the content of this document. (Show Details)Wed, Jul 29, 6:43 PM
lsandov1 edited the content of this document. (Show Details)Wed, Jul 29, 7:13 PM
lsandov1 edited the content of this document. (Show Details)Wed, Jul 29, 7:22 PM
lsandov1 published a new version of this document.
gvalante edited the content of this document. (Show Details)Wed, Jul 29, 8:22 PM
omnium21 edited the content of this document. (Show Details)Wed, Jul 29, 8:27 PM
gvalante edited the content of this document. (Show Details)Tue, Aug 4, 8:35 PM
gvalante edited the content of this document. (Show Details)
lsandov1 edited the content of this document. (Show Details)Wed, Aug 5, 4:07 PM
lsandov1 published a new version of this document.
omnium21 edited the content of this document. (Show Details)Thu, Aug 6, 8:10 AM