Bund.dev Implementing the PSI Directive in - the civic tech way - Joinup.eu
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
bund.dev Implementing the PSI Directive in – the civic tech way
Hej, I'm Lilith, I'm a hacker and civic tech activist from Berlin.
Open Data in Germany on a federal level – a bit of history
What we wanted… “ We want all data created by the government to be open and available to everyone. Without restrictions. > 15 years ago [S-5]
What we wanted… “ We want the data to be structured and datasets linked with each other. We want linked open data. > 10 years ago [S-5]
What we wanted… Linked Open Data [S-3][S-2]
covid numbers by city geographic shapes Berlin;250 Hamburg;400 …
covid numbers by city geographic shapes 122 Berlin;250 ;122 Hamburg;400 …
covid numbers by city geographic shapes 122 Berlin;250 ;122 Hamburg;400 …
What we got… (8 years ago) < [S-4]
What we got… CSV
Licensing What we wanted… What we got… Data licence Germany – public domain. attribution – version 2.0 [S-6][S-7]
What we got… “ We want allsome data created by the government to be open and available to everyone. Without restrictions.
What we got… “ We want thesome data to be structured and datasets linked with each other. We want linked open data.
In 2019… The PSI-Directive defines the concept of “High Value Dataset”, which includes information from different thematic topics and is expected to play an important role for the society and economy that have to be published completely freely and through the Application Programming Interfaces (APIs) in every member state. The availability of APIs stimulates the reuse, dissemination of dynamic data and increases business opportunities. Access to real-time and dynamic data is strongly promoted by the PSI directive, and once the directive will be fully transposed, member states have to publish dynamic open government data through APIs.
And the civic tech community…
2 years later…
2 years later… 23.7.2021 (2 years and one month later)
2 years later… 23.7.2021 (2 years and one month later) A Datennutzungsgesetz appears.
2 years later… 23.7.2021 (2 years and one month later) A Datennutzungsgesetz appears. Act governing the use of public sector data
And the civic tech community…
And the civic tech community… but only for 30seconds.
“ Data falling within the scope of this Act shall, as far as possible, be produced in accordance with the principle of ‘open by design and by default’. – Section 1 (1)
“ This Act does not create an obligation to provide data or a right to access data – Section 1 (2)
2021 The thematic categories of high-value datasets, as referred to in Article 13(1) of the Directive, are: Data Type 2016 2021 geospatial earth observation and environment meteorological statistics companies and company ownership mobility
If the government would actually care about open APIs - what would they do?
Andi Scheuer, former Federal Minister for Transport and Digital Infrastructure
Doro Bär, former State Minister for Digitization at the Federal Chancellery
App
Server App
Server API App
Server API App y.com/embed/QvXvtN1JGUvfjwLHW P
y.com/embed/M95WKFVRoiQdeJGUj V
a few hours later…
Autobahn App API 1.0.1 OAS3
openapi.yaml
Was passiert auf Deutschlands Bundesstraßen? API für aktuelle Verwaltungsdaten zu Baustellen, Staus und Ladestationen. Außerdem Zugang
zu Verkehrsüberwachungskameras und vielen weiteren Datensätzen.
Weiterführende Dokumentation
Servers
https://verkehr.autobahn.de/o/autobahn
default
GET / Liste verfügbarer Autobahnen
GET /{roadId}/services/roadworks Liste aktueller Baustellen
GET /details/roadworks/{roadworkId} Details einer Baustelle
GET /{roadId}/services/webcam Liste verfügbarer Webcams
GET /details/webcam/{webcamId} Details einer WebcamWhy dosen't the government do that?
it's better to ask forgiveness than permission
bund.de
bund.dev bund.de
✅ a few documented APIs ✅ a twitter account ✅ a github account to publish code and documentation ✅ a goverment-style landing page with really bad stock photos
one weekend later…
bundDEV VERWALTUNG DIGITAL Wir dokumentieren Deutschland Im API-Portal des Bundes nden Sie Dokumentationen zu Programmierschnittstellen von Verwaltungsleistungen und Informationsportalen des Bundes. Die Zahl online verfügbarer Schnittstellen wird im Rahmen des "Gesetzes zur Änderung des E-Government-Gesetzes und zur Einführung des Gesetzes für die Nutzung von Daten des ö entlichen Sektors" (2. Open- Data-Gesetz) bis 2024 stark anwachsen.
Over the last 4 months… … we documented >30 APIS … we grew to more than 50 contributors … we started to build API monitoring solutions and api-bindings … we weren't sued (yet)
Data Type 2016 2021 2021 EoY geospatial earth observation and environment meteorological statistics companies and company ownership mobility
?
y.com/embed/kcmK2fuX6s5xdAv9rr ?
federal agency for work - rebuilt/renamed all their API endpoints - protected some of their API endpoints with captchas - they couldn't give us any (legal) reason why we shouldn't use their API
federal agency for work - rebuilt/renamed all their API endpoints - protected some of their API endpoints with captchas - they couldn't give us any (legal) reason why we shouldn't use their API
federal agency for work - rebuilt/renamed all their API endpoints - protected some of their API endpoints with captchas - they couldn't give us any (legal) reason why we shouldn't use their API y.com/embed/Z9hjJWHFALdHKK353 M
Bundesagentur für Arbeit: Jobsuche API 2.0.0 OAS3
openapi.yaml
Die größte Stellendatenbank Deutschlands durchsuchen, Details zu Stellenanzeigen und Informationen über Arbeitgeber abrufen.
Die Authentifizierung funktioniert per OAuth 2 Client Credentials mit JWTs. Folgende Client-Credentials können dafür verwendet werden:
ClientID: c003a37f-024f-462a-b36d-b001be4cd24a
ClientSecret: 32a39620-32b3-4307-9aa1-511e3d7f48a8. Achtung: der OAuth header muss 'OAuthAccessToken' heißen.
Die API verfügt außerdem nicht über ein gültiges TLS Zertifikat. Deswegen sollte die TLS-Validierung deaktiviert werden.
Weiterführende Dokumentation
Servers
https://rest.arbeitsagentur.de/jobboerse/jobsuche-service Authorize
default
GET /pc/v4/app/jobs Jobsuche
GET /pc/v2/jobdetails/{hashID} Jobdetail
GET /pc/v2/app/jobs/{hashID}/bewerbung Bewerbung KontaktdatenWe implemented the PSI directive. Not in the way it was intended… but…
We showed what's possible.
Doing what's necessary.
We need laws that actually obliges the government to provide open data.
We need to enable the public sector to be able to provide great APIs.
APIs are only the first step. We want open software. Linked open data, …
APIs are only the first step. We want open software. Linked open data, … ttps://giphy.com/embed/cKiH5ysO2jwyG HjbBf
Thank you! @LilithWittann mail@lilithwittmann.de com/embed/eIUHAdmIrZXNJV0HyV
You can also read
