IRIS-HEP PI Chat University of Wisconsin-Madison - Tim Cartwright, 21 Apr 2021 - CERN Indico

IRIS-HEP PI Chat
University of Wisconsin–Madison

Tim Cartwright, 21 Apr 2021

Q1: Who is actively working on the project from the group and what are they doing?
 What projects are connected with the institute’s grand challenges?

 • UW–Madison team
 – Tim Cartwright: PI, OSG Deputy Director — project coordination, special projects, …
 – Brian Lin: SW Integration Lead — leads OSG Software, ATLAS liaison, CE, …
 – Mat Selmeci: SW Integration Eng. — technical lead for team, contributes to everything
 – Carl Edquist: SW Integration Eng. — contributes to packaging, tests, scripting, …
 – Tim Theisen: SW Release Manager — manages releases, coordinates testing, …
 – Aaron Moate: Systems Eng. — supports SW team and helps with local operations
 – Wen Guan: Contributes to IDDS prototype & U.S. ATLAS operations – ask Brian B.!
 • OSG-LHC projects and Grand Challenges
 – Data Processing GC: SW in general + HTTP TPC, XRootD monitoring
 – Analysis GC: Plan to package SkyHook to aid broader deployment

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 2

Q2: What are contributions of those individuals in your group to the various area(s), i.e.
 AS, IA, DOMA, SSL, SSC, OSG-LHC, MGMT

 • OSG-LHC: Cartwright, Lin, Selmeci, Edquist, Theisen, Moate

 • DOMA: Guan

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 3

Q3: What specific collaborations has the group made with other groups within IRIS-
 HEP?

 • OSG-LHC and DOMA
 – HTTP Third-Party Copy; XRootD integration, including XCache containers

 – Design, prototyping, some development, some testing in DOMA;
 packaging, containerizing, testing, and release in OSG-LHC

 • OSG-LHC and SSL
 – Software team is making container images that then are deployed in SSL clusters

 – Participated in some monthly SSL meetings

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 4

Q4: What specific collaborations has the group made with other groups or individuals
 external to IRIS-HEP? What are plans to integrate the work with the wider HEP community?

 • Collaborations with ATLAS, CMS, and WLCG
 – Brian L. attends ATLAS ADC technical coordination board, U.S. ATLAS Computing
 Facility and some CMS Tier-2, ATLAS Frontier Squid DevOps, and GDB and GDB
 steering meetings
 – Mat attends XCache DevOps meetings

 • Collaborations with other OSG sta
 – OSG Software & Release team works with OSG Technology, Operations, Research
 Facilitation, Collaboration Support, and Security teams to support the OSG mission
 – OSG Software stack bene ts the entire OSG consortium, including Tier-2s & Tier-3s

 • OSG plans to continue supporting HEP community as we have for 16+ years!
21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 5
 fi
 ff

Q5: Which contributions has the group made to the “Intellectual Hub” aspect of IRIS-
 HEP? (Including community building activities, training, outreach and broader impact.)

 • Involvement in and contributions to HEP Kubernetes meetings

 • Leading everybody (WLCG, OSG, all of dHTC) in the transition to a modern,
 open, token-based authentication and authorization framework
 – Job movement using capability-based auth.
 – Data movement using HTTP(S)

 • BI: OSG’s integrated software stack(s) — including work coming out of DOMA
 and deployments in SSL (and related) — is available to all of Open Science,
 including campuses and researchers throughout U.S. (and beyond)

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 6

Q6: Please list any papers/presentations/software-repositories connected to the
 above

 • Repositories
 – GitHub opensciencegrid project (https://github.com/opensciencegrid/ – 197 repos and counting!)
 – OSG Software Yum repositories (https://repo.opensciencegrid.org/osg/)

 • Papers (from IRIS-HEP website)
 – An intelligent Data Delivery Service for and beyond the ATLAS experiment, W. Guan, T. Maeno, B. Bockelman, T. Wenaus, F. Lin, S. Padolski, R. Zhang
 and A. Alekseev, arXiv 2103.00523 (28 Feb 2021).
 – Creating a content delivery network for general science on the internet backbone using XCaches. Fajardo E, Weitzel D, Rynge M, Zvada M, Hicks J,
 Selmeci M, Lin B, Paschos P, Bockelman B, Hanushevsky A, Würthwein F, & S ligoi I (CHEP 2019). [Not on website yet, will be today]
 – Towards an Intelligent Data Delivery Service, Wen Guan, Tadashi Maeno, Gancho Dimitrov, Brian Paul Bockelman, Torre Wenaus, Vakhtang Tsulaia, Nicolo
 Magini, CHEP2019 (14 Mar 2020).

 • Presentations (from IRIS-HEP website)
 – 11 Feb 2021 - "OSG Services and Kubernetes", Brian Lin, GP-ARGO Technical Meeting
 – 27 Jan 2021 - "iDDS active learning status and iDDS plans", Wen Guan, ADC @ ATLAS Software & Computing Week
 – 21 Jan 2021 - "iDDS 2021", Wen Guan, ATLAS ADC WFMS meeting
 – 5 Oct 2020 - "iDDS: new work ow structure", Wen Guan, ADC @ ATLAS Software & Computing Week
 – 1 Oct 2020 - "iDDS news for machine learning", Wen Guan, Joint Atlas Machine Learning / Work ow Management Meeting
 – 23 Sep 2020 - "HTCondor-CE Overview", Brian Lin, HTCondor Workshop Autumn 2020
 – 23 Sep 2020 - "HTCondor-CE Con guration", Brian Lin, HTCondor Workshop Autumn 2020
 – 23 Sep 2020 - "HTCondor-CE Live Installation", Brian Lin, HTCondor Workshop Autumn 2020
 – 23 Sep 2020 - "HTCondor-CE Troubleshooting", Brian Lin, HTCondor Workshop Autumn 2020
 – 23 Sep 2020 - "What is next for the HTCondor-CE?", Brian Lin, HTCondor Workshop Autumn 2020
 – …

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 7
 fl
 fi
 fi
 fl

Q7: How is your project managed? How is progress measured? How are risks
 identified and mitigated?

 • OSG management: Executive team Team leads (Area Coordinators) Sta
 – There is good and frequent ow of information up, down, and across
 – PATh has added complementary management activities
 – OSG Council is governing body for the OSG Consortium; elects ED, has bylaws, …

 • Jira used on most teams for projects; Freshdesk for user interactions

 • Milestones and deliverables from IRIS-HEP PEP are in Jira (usu. as Epics)

 • Risks are identi ed at all levels and communicated upward; again, good ow
 of information and team culture help ensure that risks are ID’d early and often

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 8
 fi
 fl
 fl
 ff

Q8: Are metrics aligned with the project? Do metrics accurately reflect the progress,
 success or impact of the project?

 • Yes!
 • PEP-2 metrics are new/re ned
 – Based on experience from PEP-1 and just life in general
 – Aligned with PEP-2 WBS goals and other management interests

 • Software ones cover a mix of routine and project work
 – Routine: 7.7 (pkg updates), 7.8 (test coverage), 7.9 (defects), 7.10 (orphanage), 7.11 (tickets)
 – Projects
 • 7.5 (pkgs by source) is in part about trying to package IRIS-HEP-sourced software
 • 7.6 (prod. containers) is about moving to new, container-based service deployment model

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 9
 fi

Q9: What are the plans for the next year?

 • IRIS-HEP Year 4 milestones and deliverables
 – G7.5: Have at least 5 instances of refactored XRootD monitoring in production use
 – G7.6: Complete the SDLC from engagement to prod. deployment for 1 IRIS-HEP software product (SH?)

 • IRIS-HEP Year 5 milestones and deliverables
 – G7.4: End of OSG 3.5 … and GT/GCF software — will be a focus throughout Year 4 (e.g., below)
 – G7.7: Have 1 example of an IRIS-HEP-supported service in prod. using the new container paradigm

 • October workshop on token auth transition
 – Already coordinated with WLCG as a pre-GDB event
 – Coordinating with PATh on associated events for OSG and HEP stakeholders
 – We plan to hold steady on the transition schedule until the workshop, then re-evaluate afterward

 • All-Hands Meeting March 2022: In person! 

21 Apr 2021 IRIS-HEP PI Chat – Wisconsin 10