Technical introduction: Difference between revisions
From MaRDI portal
| (36 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
= | =Technical introduction= | ||
==Portal== | |||
;[https://portal.mardi4nfdi.de/wiki/Main_Page MaRDI Portal] | |||
:MaRDI Portal main page | |||
=External links= | ;[https://portainer.portal.mardi4nfdi.de/#!/auth Portainer] | ||
;[https:// | :Manage portal containers and images. | ||
: | |||
;[https://quickstatements.portal.mardi4nfdi.de/#/ Quickstatements] | |||
:QuickStatements is a tool to batch-edit portal data | |||
;[https://query.portal.mardi4nfdi.de/#/ Query service] | |||
:Query the MaRDI portal using SPARQL | |||
;[[Project:Portal_containers | Portal containers]] | |||
:Short description of all containers in the Portal | |||
==Development== | |||
;[https://github.com/MaRDI4NFDI/portal-compose/blob/main/README.md Deployment] | |||
:How to deploy and configure the portal for different environments (local / CI / Server) | |||
===Repos=== | |||
;[https://github.com/MaRDI4NFDI Github] | |||
:MaRDI Portal main page on GitHub | |||
;[https://github.com/orgs/MaRDI4NFDI/projects/1/views/1 Project tasks] | |||
:MaRDI project tasks overview | |||
===Prototyping=== | |||
;[https://github.com/MaRDI4NFDI/portal-examples Portal examples] | |||
:Jupyter notebooks examples | |||
===Data import=== | |||
;[https://raw.githubusercontent.com/MaRDI4NFDI/docker-importer/aa696425a01b8fc9a616a46820e0f004c8bf5657/doc/activity.drawio.svg Import process overview] | |||
:UML action diagram showing import process from zwMath. | |||
;[https://github.com/MaRDI4NFDI/portal-examples/blob/main/Import%20from%20zbMath/WB_wikidata_properties.ipynb Import properties from Wikidata] | |||
:How to to import items and properties from Wikidata into the Portal. | |||
;[https://github.com/MaRDI4NFDI/portal-examples/blob/main/Import%20from%20zbMath/zbMath_filter_papers_by_software.ipynb Read data from zbMath] | |||
:There are millions of references to papers in the zbMath database. We just need (for now) those related to the list of mathematical software that has been imported into the MaRDI-Portal. | |||
;[https://github.com/MaRDI4NFDI/portal-examples/blob/main/Import%20from%20zbMath/WBAPI_populate_portal.ipynb Populate the portal using the Wikibase API] | |||
:Import the data read from zbMath into the data structure setup from properties imported from Wikidata. | |||
===Testing=== | |||
;[https://portal.mardi4nfdi.de/wiki/Project:Testing_concept Testing concept] | |||
:General guidelines about testing the MaRDI Portal. | |||
;[https://github.com/aot29/docker-selenium Selenium], see also [https://github.com/MaRDI4NFDI/portal-compose/blob/main/README.md Deployment] | |||
:Selenium container documentation | |||
===Backup=== | |||
;[https://github.com/MaRDI4NFDI/docker-backup Backup and restore] | |||
:How to configure automatically and manually backup the data, and restore a backup. | |||
==External links== | |||
===Wikibase Stakeholder Group (WBSG)=== | |||
;[https://wbstakeholder.group/projects/ WBSG projects] and [https://loomio.rhizome.org/wbsg WBSG Rhizome Loomio (requires login)] | |||
:The Wikibase Stakeholder Group coordinates a variety of projects for the broader Wikibase ecosystem. | |||
===How-to's Wikidata=== | |||
;[https://www.youtube.com/watch?v=46pQQLpIiaU Why Wikibase? Why not?] | |||
:Columbia University’s Morningside campus in New York City, the Knowledge Graph Conference (KGC) | |||
;[https://librarycarpentry.org/lc-wikidata/05-intro_to_querying/index.html Library Carpentry Wikidata] | |||
:This Library Carpentry lesson introduces librarians to Wikidata. | |||
;[https://stuff.coffeecode.net/2018/wikibase-workshop-swib18.html Wikibase: configure, customize, and collaborate] | |||
:These are the materials for a workshop on getting started with Wikibase, offered at Semantic Web in Libraries 2018 in Bonn, Germany on November 26, 2018. | |||
;[https://medium.com/@thisismattmiller/wikibase-for-research-infrastructure-part-1-d3f640dfad34 Wikibase for Research Infrastructure] | |||
:Getting started with Wikibase for your own research. | |||
;[https://de.slideshare.net/lysander07?utm_campaign=profiletracking&utm_medium=sssite&utm_source=ssslideview Harald Sack presentations] | |||
:Professor of Information Service Engineering | |||
;[https://open.hpi.de/courses/knowledgegraphs2020 Knowledge Graphs (Open HPI)] | |||
:Prof. Dr. Harald Sack, Dr. Mehwish Alam | |||
===General development=== | |||
;[https://www.youtube.com/watch?v=X48VuDVv0do Kubernetes Tutorial for Beginners] | |||
:Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos | |||
;[https://gabrieltanner.org/blog/docker-compose The definitive Guide to Docker compose] | |||
:Everything you need to know about Docker Compose and how you can use it to run multi-container applications. | |||
;[https://selenium-python.readthedocs.io/index.html Selenium with Python] | |||
:Selenium Python bindings provides a simple API to write functional/acceptance tests using Selenium WebDriver. | |||
===Wikibase and Wikidata=== | |||
;[https://github.com/blazegraph/database/wiki Blazegraph] | |||
:Blazegraph™ DB is a ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs. | |||
;[https://linkedopendata.eu/wiki/The_EU_Knowledge_Graph The EU Knowledge Graph] | |||
:This graph contains structured information about the European Union. | |||
;[https://gerrit.wikimedia.org Gerrit] | ;[https://gerrit.wikimedia.org Gerrit], [https://phabricator.wikimedia.org/ Phabricator] | ||
:Wikimedia code review | :Wikimedia code review (Gerrit), collaboration platform open to all Wikimedia contributors (Phabricator). | ||
;[https:// | ;[https://www.mediawiki.org/wiki/API:Main_page MediaWiki API overview], [https://www.wikidata.org/w/api.php?action=help&modules=wbsearchentities MediaWiki API] | ||
: | :The MediaWiki Action API is a web service that allows access to some wiki-features like authentication, page operations, and search. | ||
;[https:// | ;[https://www.wikidata.org/wiki/Wikidata:SPARQL_tutorial SPARQL] and [https://rdflib.dev/sparqlwrapper/ SPARQL Endpoint interface to Python] | ||
:SPARQL is a language to formulate questions (queries) for knowledge databases. | :SPARQL is a language to formulate questions (queries) for knowledge databases. | ||
;[https://www.mediawiki.org/wiki/Wikibase/Docker Wikibase/Docker documentation], [https://github.com/wmde/wikibase-docker Github] | |||
:Installing the Docker images for Wikibase. | |||
;[https://www.mediawiki.org/wiki/Help:Formatting Wiki markup] | ;[https://www.mediawiki.org/wiki/Help:Formatting Wiki markup] | ||
:Mediawiki formatting help | :Mediawiki formatting help. | ||
;[https://wikiba.se/ Wikibase] | |||
:Open-source software suite for creating collaborative knowledge bases. | |||
;[https://query.wikidata.org/ Wikidata Query Service], [https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual Wikidata Query Service user manual] | |||
:Wikidata Query Service (WDQS) is a software package and public service designed to provide a SPARQL endpoint which allows you to query against the Wikidata data set. | |||
;[https://github.com/Wikidata/WikibaseImport WikibaseImport extension] | |||
:WikibaseImport is a MediaWiki extension that provides a maintenance script for importing entities from another Wikibase instance. (e.. Wikidata) | |||
;[https://wikitech.wikimedia.org/wiki/Main_Page Wikitech] | |||
:Wikitech is the home of technical documentation of Wikimedia Foundation infrastructure and services. | |||
Latest revision as of 12:02, 10 March 2022
Technical introduction
Portal
- MaRDI Portal
- MaRDI Portal main page
- Portainer
- Manage portal containers and images.
- Quickstatements
- QuickStatements is a tool to batch-edit portal data
- Query service
- Query the MaRDI portal using SPARQL
- Portal containers
- Short description of all containers in the Portal
Development
- Deployment
- How to deploy and configure the portal for different environments (local / CI / Server)
Repos
- Github
- MaRDI Portal main page on GitHub
- Project tasks
- MaRDI project tasks overview
Prototyping
- Portal examples
- Jupyter notebooks examples
Data import
- Import process overview
- UML action diagram showing import process from zwMath.
- Import properties from Wikidata
- How to to import items and properties from Wikidata into the Portal.
- Read data from zbMath
- There are millions of references to papers in the zbMath database. We just need (for now) those related to the list of mathematical software that has been imported into the MaRDI-Portal.
- Populate the portal using the Wikibase API
- Import the data read from zbMath into the data structure setup from properties imported from Wikidata.
Testing
- Testing concept
- General guidelines about testing the MaRDI Portal.
- Selenium, see also Deployment
- Selenium container documentation
Backup
- Backup and restore
- How to configure automatically and manually backup the data, and restore a backup.
External links
Wikibase Stakeholder Group (WBSG)
- WBSG projects and WBSG Rhizome Loomio (requires login)
- The Wikibase Stakeholder Group coordinates a variety of projects for the broader Wikibase ecosystem.
How-to's Wikidata
- Why Wikibase? Why not?
- Columbia University’s Morningside campus in New York City, the Knowledge Graph Conference (KGC)
- Library Carpentry Wikidata
- This Library Carpentry lesson introduces librarians to Wikidata.
- Wikibase: configure, customize, and collaborate
- These are the materials for a workshop on getting started with Wikibase, offered at Semantic Web in Libraries 2018 in Bonn, Germany on November 26, 2018.
- Wikibase for Research Infrastructure
- Getting started with Wikibase for your own research.
- Harald Sack presentations
- Professor of Information Service Engineering
- Knowledge Graphs (Open HPI)
- Prof. Dr. Harald Sack, Dr. Mehwish Alam
General development
- Kubernetes Tutorial for Beginners
- Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
- The definitive Guide to Docker compose
- Everything you need to know about Docker Compose and how you can use it to run multi-container applications.
- Selenium with Python
- Selenium Python bindings provides a simple API to write functional/acceptance tests using Selenium WebDriver.
Wikibase and Wikidata
- Blazegraph
- Blazegraph™ DB is a ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs.
- The EU Knowledge Graph
- This graph contains structured information about the European Union.
- Gerrit, Phabricator
- Wikimedia code review (Gerrit), collaboration platform open to all Wikimedia contributors (Phabricator).
- MediaWiki API overview, MediaWiki API
- The MediaWiki Action API is a web service that allows access to some wiki-features like authentication, page operations, and search.
- SPARQL and SPARQL Endpoint interface to Python
- SPARQL is a language to formulate questions (queries) for knowledge databases.
- Wikibase/Docker documentation, Github
- Installing the Docker images for Wikibase.
- Wiki markup
- Mediawiki formatting help.
- Wikibase
- Open-source software suite for creating collaborative knowledge bases.
- Wikidata Query Service, Wikidata Query Service user manual
- Wikidata Query Service (WDQS) is a software package and public service designed to provide a SPARQL endpoint which allows you to query against the Wikidata data set.
- WikibaseImport extension
- WikibaseImport is a MediaWiki extension that provides a maintenance script for importing entities from another Wikibase instance. (e.. Wikidata)
- Wikitech
- Wikitech is the home of technical documentation of Wikimedia Foundation infrastructure and services.
