Technical introduction: Difference between revisions

From MaRDI portal
Alvaro (talk | contribs)
 
(23 intermediate revisions by 2 users not shown)
Line 1: Line 1:
=General=
=Technical introduction=
 
==Portal==
==Portal==
;[https://portal.mardi4nfdi.de/wiki/Main_Page MaRDI Portal]
;[https://portal.mardi4nfdi.de/wiki/Main_Page MaRDI Portal]
Line 13: Line 12:
;[https://query.portal.mardi4nfdi.de/#/ Query service]
;[https://query.portal.mardi4nfdi.de/#/ Query service]
:Query the MaRDI portal using SPARQL
:Query the MaRDI portal using SPARQL
;[[Project:Portal_containers | Portal containers]]
:Short description of all containers in the Portal


==Development==
==Development==
;[https://github.com/MaRDI4NFDI/portal-compose/blob/main/README.md Deployment]
:How to deploy and configure the portal for different environments (local / CI / Server)
===Repos===
;[https://github.com/MaRDI4NFDI Github]
;[https://github.com/MaRDI4NFDI Github]
:MaRDI Portal main page on GitHub
:MaRDI Portal main page on GitHub
Line 21: Line 27:
:MaRDI project tasks overview
:MaRDI project tasks overview


=External links=
===Prototyping===
;[https://github.com/MaRDI4NFDI/portal-examples Portal examples]
:Jupyter notebooks examples
 
===Data import===
;[https://raw.githubusercontent.com/MaRDI4NFDI/docker-importer/aa696425a01b8fc9a616a46820e0f004c8bf5657/doc/activity.drawio.svg Import process overview]
:UML action diagram showing import process from zwMath.
 
;[https://github.com/MaRDI4NFDI/portal-examples/blob/main/Import%20from%20zbMath/WB_wikidata_properties.ipynb Import properties from Wikidata]
:How to to import items and properties from Wikidata into the Portal.
 
;[https://github.com/MaRDI4NFDI/portal-examples/blob/main/Import%20from%20zbMath/zbMath_filter_papers_by_software.ipynb Read data from zbMath]
:There are millions of references to papers in the zbMath database. We just need (for now) those related to the list of mathematical software that has been imported into the MaRDI-Portal.
 
;[https://github.com/MaRDI4NFDI/portal-examples/blob/main/Import%20from%20zbMath/WBAPI_populate_portal.ipynb Populate the portal using the Wikibase API]
:Import the data read from zbMath into the data structure setup from properties imported from Wikidata.
 
===Testing===
;[https://portal.mardi4nfdi.de/wiki/Project:Testing_concept Testing concept]
:General guidelines about testing the MaRDI Portal.
 
;[https://github.com/aot29/docker-selenium Selenium], see also [https://github.com/MaRDI4NFDI/portal-compose/blob/main/README.md Deployment]
:Selenium container documentation
 
===Backup===
;[https://github.com/MaRDI4NFDI/docker-backup Backup and restore]
:How to configure automatically and manually backup the data, and restore a backup.
 
==External links==
 
===Wikibase Stakeholder Group (WBSG)===
;[https://wbstakeholder.group/projects/ WBSG projects] and [https://loomio.rhizome.org/wbsg WBSG Rhizome Loomio (requires login)]
:The Wikibase Stakeholder Group coordinates a variety of projects for the broader Wikibase ecosystem.
 
===How-to's Wikidata===
;[https://www.youtube.com/watch?v=46pQQLpIiaU Why Wikibase? Why not?]
:Columbia University’s Morningside campus in New York City, the Knowledge Graph Conference (KGC)
 
;[https://librarycarpentry.org/lc-wikidata/05-intro_to_querying/index.html Library Carpentry Wikidata]
:This Library Carpentry lesson introduces librarians to Wikidata.
 
;[https://stuff.coffeecode.net/2018/wikibase-workshop-swib18.html Wikibase: configure, customize, and collaborate]
:These are the materials for a workshop on getting started with Wikibase, offered at Semantic Web in Libraries 2018 in Bonn, Germany on November 26, 2018.
 
;[https://medium.com/@thisismattmiller/wikibase-for-research-infrastructure-part-1-d3f640dfad34 Wikibase for Research Infrastructure]
:Getting started with Wikibase for your own research.
 
;[https://de.slideshare.net/lysander07?utm_campaign=profiletracking&utm_medium=sssite&utm_source=ssslideview Harald Sack presentations]
:Professor of Information Service Engineering
 
;[https://open.hpi.de/courses/knowledgegraphs2020 Knowledge Graphs (Open HPI)]
:Prof. Dr. Harald Sack, Dr. Mehwish Alam
 
===General development===
;[https://www.youtube.com/watch?v=X48VuDVv0do Kubernetes Tutorial for Beginners]
:Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
 
;[https://gabrieltanner.org/blog/docker-compose The definitive Guide to Docker compose]
:Everything you need to know about Docker Compose and how you can use it to run multi-container applications.
 
;[https://selenium-python.readthedocs.io/index.html Selenium with Python]
:Selenium Python bindings provides a simple API to write functional/acceptance tests using Selenium WebDriver.
 
===Wikibase and Wikidata===
;[https://github.com/blazegraph/database/wiki Blazegraph]
;[https://github.com/blazegraph/database/wiki Blazegraph]
:Blazegraph™ DB is a ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs.
:Blazegraph™ DB is a ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs.
;[https://linkedopendata.eu/wiki/The_EU_Knowledge_Graph The EU Knowledge Graph]
:This graph contains structured information about the European Union.


;[https://gerrit.wikimedia.org Gerrit], [https://phabricator.wikimedia.org/ Phabricator]
;[https://gerrit.wikimedia.org Gerrit], [https://phabricator.wikimedia.org/ Phabricator]

Latest revision as of 12:02, 10 March 2022

Technical introduction

Portal

MaRDI Portal
MaRDI Portal main page
Portainer
Manage portal containers and images.
Quickstatements
QuickStatements is a tool to batch-edit portal data
Query service
Query the MaRDI portal using SPARQL
Portal containers
Short description of all containers in the Portal

Development

Deployment
How to deploy and configure the portal for different environments (local / CI / Server)

Repos

Github
MaRDI Portal main page on GitHub
Project tasks
MaRDI project tasks overview

Prototyping

Portal examples
Jupyter notebooks examples

Data import

Import process overview
UML action diagram showing import process from zwMath.
Import properties from Wikidata
How to to import items and properties from Wikidata into the Portal.
Read data from zbMath
There are millions of references to papers in the zbMath database. We just need (for now) those related to the list of mathematical software that has been imported into the MaRDI-Portal.
Populate the portal using the Wikibase API
Import the data read from zbMath into the data structure setup from properties imported from Wikidata.

Testing

Testing concept
General guidelines about testing the MaRDI Portal.
Selenium, see also Deployment
Selenium container documentation

Backup

Backup and restore
How to configure automatically and manually backup the data, and restore a backup.

External links

Wikibase Stakeholder Group (WBSG)

WBSG projects and WBSG Rhizome Loomio (requires login)
The Wikibase Stakeholder Group coordinates a variety of projects for the broader Wikibase ecosystem.

How-to's Wikidata

Why Wikibase? Why not?
Columbia University’s Morningside campus in New York City, the Knowledge Graph Conference (KGC)
Library Carpentry Wikidata
This Library Carpentry lesson introduces librarians to Wikidata.
Wikibase: configure, customize, and collaborate
These are the materials for a workshop on getting started with Wikibase, offered at Semantic Web in Libraries 2018 in Bonn, Germany on November 26, 2018.
Wikibase for Research Infrastructure
Getting started with Wikibase for your own research.
Harald Sack presentations
Professor of Information Service Engineering
Knowledge Graphs (Open HPI)
Prof. Dr. Harald Sack, Dr. Mehwish Alam

General development

Kubernetes Tutorial for Beginners
Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
The definitive Guide to Docker compose
Everything you need to know about Docker Compose and how you can use it to run multi-container applications.
Selenium with Python
Selenium Python bindings provides a simple API to write functional/acceptance tests using Selenium WebDriver.

Wikibase and Wikidata

Blazegraph
Blazegraph™ DB is a ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs.
The EU Knowledge Graph
This graph contains structured information about the European Union.
Gerrit, Phabricator
Wikimedia code review (Gerrit), collaboration platform open to all Wikimedia contributors (Phabricator).
MediaWiki API overview, MediaWiki API
The MediaWiki Action API is a web service that allows access to some wiki-features like authentication, page operations, and search.
SPARQL and SPARQL Endpoint interface to Python
SPARQL is a language to formulate questions (queries) for knowledge databases.
Wikibase/Docker documentation, Github
Installing the Docker images for Wikibase.
Wiki markup
Mediawiki formatting help.
Wikibase
Open-source software suite for creating collaborative knowledge bases.
Wikidata Query Service, Wikidata Query Service user manual
Wikidata Query Service (WDQS) is a software package and public service designed to provide a SPARQL endpoint which allows you to query against the Wikidata data set.
WikibaseImport extension
WikibaseImport is a MediaWiki extension that provides a maintenance script for importing entities from another Wikibase instance. (e.. Wikidata)
Wikitech
Wikitech is the home of technical documentation of Wikimedia Foundation infrastructure and services.