Contents
- Themes
- Projects
- Tools Vocabularies
Data
- URIs, HTTP, HTML, HTML5
- Linked Data (RDF, RDFa, JSONLD)
- Graphs, Nodes, Edges
seeAlso:
Resume projects:
Projects I have created:
Open Source Projects I have contributed to:
- https://westurner.github.io/wiki/contributions
- Src: https://github.com/westurner/wiki/wiki/contributions
- ENH,UBY: Vsplit the terminal with 2 panes: 1) scrollback; 2) current prompt.
- ENH,UBY: auto expand the focused terminal pane
- ENH,UBY: (with vim-like shortcuts; Ctrl-W _, Ctrl-W=, Ctrl-W-[j|k])
- ENH,UBY: auto expand the focused terminal pane
- (Directed) edges between tweets, later
- Visualize "View Conversation" directed edges
- Add edges with attributes and provenance metadata
- Add a hashtag (recent/all tags w/ checkboxes)
- Use case: I am developing a report on [Self Directed Learning], and have a few topics I'd like to discover and curate, mashup, remix
- [ ] Twitter #JSONLD @context
- Additional properties:
- Expanded links
- Picture URIs
- Twitter Card Metadata
- OpenGraph Metadata
- Extracted RDF
- Parse Errors
- Additional edge classes:
- TopicEdge
- ReplyEdge
- ReplyWithCommentEdge
- Additional properties:
- FOAF, SIOC, Schema.org
- Extract links, count uniques
- #Nanotation RDF microsyntax (seeAlso: Sphinx Extensions)
- Tab-completion for subjects, predicates, objects?
- Sequences of actions
- "Because think first"
- Concept stage
- EAV visualization
- RDFLib IPython notebook
- RDF exploration CLI
- https://github.com/jonathanslenders/python-prompt-toolkit
- schema-aware tab-completion
- sphinxcontrib-RDF
- https://github.com/westurner/sphinxcontrib-rdf
- Directive to include an RDF syntax w/ pygments highlighting (see: healthref (ttl))
- Extract triples from an RST (docutils) node graph
- Role w/ context? (like RDFa)
- sphinxcontrib-ipython
- run sphinx docs with
.. ipython::
directives through IPython interactively (e.g. w/ tmpipnb) - ipythonify tests (ipython_nose + what API w/ a notebook?)
- run sphinx docs with
- sphinxcontrib-srclinks
- Add links to {Source, Edit, History, Annotate} with {GitHub, BitBucket,} to the Sphinx HTML template sidebar.
- Source: https://github.com/westurner/sphinxcontrib-srclinks
- jinja2 template and contexts
- sphinx extensions
- Add an arrow indicating the currently selected heading (⬅)
- Add an arrow indicating the currently selected TOC heading (⬅)
- Scroll the sidebar to the selected TOC heading (¶)
- "Open link in new tab"
- "Show visited links"
- [ ] Factor into sphinxcontrib. plugins
- Source: https://github.com/wrdrd/docs/tree/master/docs/_static/js
Use cases:
- https://mail.python.org/pipermail/python-ideas/2014-December/030228.html
- incentivization of actionable crossreferences
- PEP research
- "is this actionable?"
- "are we voting?"
- Crawl/parse/extract links and +1 from given thread(s)
- Detect a few standard link types:
- Issue
- Src
- Doc
- Ref
- x-link
- +1s with expandable snippets? (like
grep -C
)
- Detect a few standard link types:
- There could be configurable per-list link heuristics:
- http[s]
- Issue: https://bugs.python.org/issue(d+)
- Src: https://hg.python.org/<repo>/<path>
- Src: https://github.com/<org>/<project>/<path>
- Src: https://bitbucket.org/<org>/<project>/<path>
- Patch/Attachment: https://bugs.python.org/(file[d]+)/<filename(.diff)>
- Doc: https://docs.python.org/<ver>/<path>
- Wiki: https://wiki.python.org/moin/<path>
- Homepage: https://www.python.org/<path>
- Build: http://buildbot.python.org/all/builders/AMD64%20Ubuntu%20LTS%203.4/builds/771
- Packages
- PyPI pkg: https://pypi.python.org/pypi/<path>
- Warehouse pkg: https://warehouse.python.org/project/<path>
- Wikipedia: https://[lang].wikipedia.org/wiki/<page> --> (dbpedia:<page>)
- This could - most efficiently - be added to mailman (e.g. in Postorious and/or HyperKitty)
build URI paths with
/
URL encoding
some combination of operators could be useful:
scheme://[email protected]:port/path/?query#fragment from _ import URI, https, //, http https // '[email protected]:port' / path ** query % fragment
__div__ /
__floordiv__ //
__and__ &&
__mod__ %
__invert__ ~
__or__ |
__xor__ ^
__and__ +
__mul__ *
__pow__ **
__lshift__ <<
__rshift__ >>
- https://pypi.python.org/pypi/path.py -- __div__
- https://pypi.python.org/pypi/pathlib (stdlib)
- https://pypi.python.org/pypi/furl
- https://pypi.python.org/pypi/URLObject
- https://pypi.python.org/pypi/rdflib
https://lists.w3.org/Archives/Public/public-vocabs/2015Feb/0121.html
- http://schema.org/Animal ( http://schema.org/AnimalShelter )
- Labeling (e.g. ImageNet animals)
- Matching / gamification
.
What is schema.org?
https://wrdrd.github.io/docs/consulting/knowledge-engineering#schema-org
- Multi-Track Video Editing
- https://github.com/westurner/brw (IFrame carousel timer)
- https://github.com/westurner/pbm (Bookmarks JSON CLI & Tornado app w/ brw)
- https://lists.w3.org/Archives/Public/public-schema-course-extend/2016Jan/0020.html
- https://twitter.com/westurner/status/738471673767165953
- Fading, Beatmatching, Event spike synchronicity (cuepoints)
- JSONLD (schema.org RDF)
- learning from prepared materials / learning by watching / learning by doing
- Linked-
- StudyGraph
- StructuredPremises
- LinkedMetaAnalyses
Links:
#LinkedReproducibility
- https://twitter.com/hashtag/linkedreproducibility
- https://wrdrd.github.io/docs/consulting/data-science#linked-reproducibility
- https://wrdrd.github.io/docs/consulting/linkedreproducibility
- https://news.ycombinator.com/item?id=11685292
- https://news.ycombinator.com/item?id=12195302
Note
See: westurner/nbmeta#1
Jupyter Notebook
_repr_html_
=> RDFa and/or JSONLDChallenges / Objectives
I want some metadata to be displayed at the top; but also to add metadata through the notebook
Metadata about the JupyterNotebook
"Add JSONLD @context to the top level .ipynb node " jupyter/nbformat#44
Example JupyterNotebook metadata:
{"@context": {"schema": "http://schema.org/"}, "@type": ["schema:JupyterNotebook", "schema:ScholarlyArticle", "schema:DataCatalog"], # dataset/hasPart ? "name": "Notebook Name", "author": { "@type": "schema:Person", "givenName": "Wesley", "familyName": "Turner", "url": "https://westurner.github.io/" }, "dateCreated": "2016-09-20" }
Metadata from the JupyterNotebook
{"@context": { "schema": "http://schema.org/", "prov": "http://www.w3.org/ns/prov#"}, ..., "hasPart": { "@type": "schema:Dataset", "name": "Months of the Year", "distribution": { "@type": "schema:DataDownload", "contentUrl": "http://...", "encodingFormat": "CSV", # URI? } } }
- SoftwareApplication versions
- version_information, watermark
- requirements.txt
- SoftwareApplication versions
[EDIT]
see: - jupyter/nbformat#44 (comment)
schema.org classes for @type=[":JupyterNotebook",]
:
- https://schema.org/CreativeWork
- https://schema.org/DigitalDocument
- https://schema.org/Article
- https://schema.org/ScholarlyArticle
- https://schema.org/CreativeWorkSeries
- https://schema.org/ItemList
nbmeta is a research project for structured data in Jupyter (IPython) Notebooks.
Objectives
- Store and publish JSONLD and RDFa
- westurner/nbmeta#1
nbmeta and #LinkedReproducibility
- StudyGraph -- things with structured edges (:CreativeWork with :name, :url, :authors, :funders, :about)
- StructuredPremises -- premises with structured edges, satisfaction criteria
- LinkedMetaAnalyses -- shared structured metadata, variable inclusion criteria
- See: RDFJS pad re "Tools Schema" Classes and Properties: https://text.allmende.io/p/rdfjs
Central tools.rst [ ... -> tools.rdf, tools.ttl, tools.jsonld ]
-
- Projects that link with westurner.github.io/tools: provis, dotfiles, https://wrdrd.github.io/docs/tools