Api ! Rest
Uploaded by
brunoApi ! Rest
Uploaded by
brunoAPI !
= REST - PROCMAIL TO THE RESCUE
By HPE DEV Team
and HPE CIC Team
Introducing Bruno Cornec
●
Software engineering and Unices since 1988:
– Mostly Configuration Management Systems, Build systems, quality tools, on multiple Unix systems
– Discovered Open Source & Linux (OSL) & made first contributions in 1993
– Full time on OSL since 1995, first as HPE reseller then @HPE
●
Currently:
– OSL Technology Strategist in HPE WW Customer Innovation Center, Grenoble, France
– WW Linux Community Lead for the HPE Open Source Profession
– Conferences at WW level at LinuxCon, Linux.conf.au (2007, 2013, 2014), Fosdem, RMLL POSS, ...
– MondoRescue, Project-Builder.org, python-redfish, UUWL and PUSK Project Lead
– LinuxCOE, mrepo, tellico, rinse, fossology, collectl, Ironic contributor
– FOSSBazaar/SPDX and OSL Governance enthusiast
– Mandriva, Mageia, Fedora packager
●
And also:
– Amateur singer (Alto / Tenor), recorder player since 1976 and Choir director since 1987, CD collector (7500+), Concerts, Photography
2
Introducing Frédéric Passeron
●
20 years @HPE in presales organizations
●
Strong focus on solutions (HP Toptools, HPSIM, Matrix, HP CloudSystem,
HP Helion Openstack, HPE OneSphere HPE Ezmeral)
●
Currently:
– HPE Dev Experience team Solution Architect
– Hack Shack Workshop on Demand (WoD) Program Manager
– Vlub project management A place for developers to gather
– Volumio contributor Inviting atmosphere
Informative and fun
●
And also:
Physical now virtual
– High end HI-FI systems fan (see video !)
Workshops The Hack Shack@KubeCon
– Musical Streamer builder Hands-on training
On-demand
Use of Jupyter notebooks It was announced at KubeCon Austin in
Challenge December 2017
Augments workshop material
Main goal: “Accelerate Innovation
Prizes offered for creativity through Sharing , Communicating and
Replays
Collaborating among members of the
developer community”
Community 3
Popular Hack Shack Attack game
Why a Mail API ?
● End of 2019 :
– Need for a new way of delivering labs, Workshops:
– Move away from pdf and putty sessions…
– Jupyter Technology looked interesting:
● 2020 Covid 2019 Pandemy
– Need to accelerate to support virtual Events (TSS 2020, HPE
DVE 2020, KubeCon...)
– Build up first two jupyterhub servers (Staging and prod)
– Many manual processes to handle workshop management @
first
– One ANSIBLE Playbook to distribute notebooks over the
different Students and a few scripts…
– No Registration Portal
– No Automation
● First Beta after Discover 2020
– First registration portal and early works on Mail API
– Pilot in October 2020
● Production in October 2020
– More than 1500 Workshops delivered since October 2020
4
INFRASTRUCTURE u d ent & p Registration portal - Netlify
2 st ok setu
IN PLACE bo
note p API)
Infrastructure hosting API (smt
Endpoints
Jupyterhub Server
(postfix + procmail) https://hackshack.hpedev.io/workshops
A single DL360 Gen10 Server
2 and 4 back-end
update
3 appliances setup (REST API)
(ssh+REST API)
1 WoD
(http)
7 appliances
interaction 5 user info
• HPE OneView Appliances (REST API) (smtp)
• Nimble Virtual Arrays
• HA HPE Container Platform MLOPS
• Aruba OVAs
• Redfish/OpenBMC VMs 6 training
(http)
5
A MAIL API, REALLY ?
• Not all systems are https reachable (security)
• Mail provides some advantages over https
– free queuing system
– Passes complex network setup
• Procmail helps manage API mail requests
– Easy input filtering
– Easy parameters management
– Script called from procmail to perform actions
• Tests are easy to perform
6
ANSIBLE + NOTEBOOKS
●
Ansible is used for
– Platform installation
– Platform conformity and convergence
– Student setup including notebooks instantiation
●
Usage of variables to support multi-site
– Sandbox, staging, production, dev, ...
●
Usage of Jinja2 features to individualize notebooks
7
LIVE VIDEO EXAMPLE
IT'S SHOW TIME FOLKS !
8
THERE'S MORE AND WHAT'S NEXT ?
●
Everything under private git
●
25 Workshops in production
●
Built on Ubuntu 20.04 + Jupyter kernels
– python, bash, powershell, go, rust, java, ansible, ssh
●
Future steps:
– 2 more workshops per month
– Improved CI/CD (automated tests per commit)
– CentOS port (Done mostly)
– Docker spawner for Jupyter
– NoteBook completion Measurement (Ongoing)
– Open Sourcing
– More Notebooks (Ongoing)
9
BUILD | COMMUNICATE | COLLABORATE
hpedev.io
hpedev.slack.com
Monthly Newsletter
mailto:[email protected]
@HPE_DevCom
Yammer Group (Internal)
Yammer Group (Partner)
Workshops-on-Demand
10
THANK YOU
[email protected]
[email protected]
