Linked Data Notifications
- This version:
- https://linkedresearch.org/ldn/
- Latest published version:
- https://www.w3.org/TR/ldn/
- Previous version:
- https://www.w3.org/TR/2017/REC-ldn-20170502/
- Notifications Inbox
- inbox/
- Annotation Service
- annotation/
- Published
- Modified
- Implementation reports
- https://linkedresearch.org/ldn/tests/summary
- Test suite
- https://linkedresearch.org/ldn/tests/
- In reply to
- Social Web Working Group Charter
Copyright © 2016 W3C® (MIT, ERCIM, Keio, Beihang). W3C liability, trademark and document use rules apply.
Abstract
Linked Data Notifications is a protocol that describes how servers (receivers) can have messages pushed to them by applications (senders), as well as how other applications (consumers) may retrieve those messages. Any resource can advertise a receiving endpoint (Inbox) for the messages. Messages are expressed in RDF, and can contain any data.
Status of This Document
This section describes the status of this document at the time of its publication. Other documents may supersede this document. A list of current W3C publications and the latest revision of this technical report can be found in the W3C technical reports index at https://www.w3.org/TR/.
This document was published by the Social Web Working Group as a Working Draft. This document is intended to become a W3C Recommendation. If you wish to make comments regarding this document, please send them to public-socialweb@w3.org (subscribe, archives). All comments are welcome.
Publication as a Working Draft does not imply endorsement by the W3C Membership. This is a draft document and may be updated, replaced or obsoleted by other documents at any time. It is inappropriate to cite this document as other than work in progress.
This document was produced by a group operating under the 5 February 2004 W3C Patent Policy. W3C maintains a public list of any patent disclosures made in connection with the deliverables of the group; that page also includes instructions for disclosing a patent. An individual who has actual knowledge of a patent which the individual believes contains Essential Claim(s) must disclose the information in accordance with section 6 of the W3C Patent Policy.
This document is governed by the 1 September 2015 W3C Process Document.
Introduction
Data on the Web should not be locked in to particular systems or be only readable by the applications which created it. Users should be free to switch between applications and share data between them. Applications generate notifications about activities, interactions, and new information, which may be presented to the user or processed further.
Linked Data Notifications (LDN) supports sharing and reuse of notifications across applications, regardless of how they were generated. This allows for more modular systems, which decouple data storage from the applications which display or otherwise make use of the data. The protocol is intended to allow senders, receivers and consumers of notifications, which are independently implemented and run on different technology stacks, to seamlessly work together, contributing to decentralisation of our interactions on the Web.
Instead of treating notifications as ephemeral or non-persistent entities, this specification enables the notion of a notification as an individual entity with its own URI. As such, notifications can be retrieved and reused. We support a range of different application domains, social and otherwise, thus the contents of notifications are left up to applications to define. Authentication and verification of notifications is encouraged, but the mechanism to do so is at the discretion of receivers and consumers, as needs differ according to types of notification and different application domains.
Overview
A sender is triggered, either by a human or an automatic process, to deliver a notification to a server. The notification is data intended for the attention of the receiver, for example: a personal message from a friend; a pingback link; a comment on a blog post; an invitation to collaborate; a calendar reminder; a scientific observation.
The sender chooses a target resource to send notifications to; the sender then discovers the location of the target’s Inbox, and sends the notification there. Any resource can advertise an Inbox. The receiver exposes the notification data (according to appropriate access control) for use by consumers.
Consumers discover the location of the Inbox in the same way as the sender, and may perform further processing on the notifications, combine it with some other data, or simply present it in a suitable human-readable way.
Summary
Senders and consumers discover a resource’s Inbox URL through a relation in the HTTP Link
header or body of the resource.
The Sender:
- Creates the body of the notification according to the needs of application.
- Sends the notification to the Inbox URL by making a
POST
request, containing the body in JSON-LD or in another serialization acceptable by the server.
The Receiver:
- Responds to
GET
requests made to the Inbox URL with a listing of the URLs of notifications that have previously been accepted. - Responds to
GET
requests made to the individual notification URLs with JSON-LD (or optionally other serializations). - Accepts
POST
requests at the Inbox URL to create notifications. - Optionally enforces constraints on notifications sent to the Inbox.
The Consumer:
- Retrieves the contents of the Inbox URL with a
GET
request, and uses according to the needs of application.
Relation to Linked Data Platform
LDN is a specialized use of Linked Data Platform [LDP] for sending and consuming notifications. It is not dependent on a complete implementation of LDP, but an easy-to-implement subset. Having knowledge of LDP is not required to understand this specification, but those who do will find some concepts familiar. We describe the particular features necessary to make it easy to exchange notifications in a decentralised, interoperable way. An LDN Inbox is comparable to an LDP BasicContainer
.
Conformance
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in [RFC2119]. As well as sections marked as non-normative, all authoring guidelines, diagrams, examples, and notes in this specification are non-normative.
Conformance Classes
LDN implementations may be senders, receivers or consumers. The conformance criteria for each of these roles are described in their respective sections of this specification.
Protocol
This section describes the discovery of the URL to which notifications are delivered or read from (the Inbox) and the delivery mechanism. Notification contents are described in Payload.
Discovery
An Inbox, the endpoint to which notifications are sent or from which they are consumed, can be discovered from any resource, for example a blog post, a user profile, a dataset, a video. The starting point for discovery is the resource which the notification is to or about: the target. Choosing the most appropriate target resource from which to begin discovery is at the discretion of the sender or consumer, since any resource (RDF or non-RDF) may have its own Inbox.
Senders and consumers do the following to discover the Inbox URL:
- make an HTTP
HEAD
orGET
request on the target URL, and use theLink
header with arel
value ofhttp://www.w3.org/ns/ldp#inbox
. - make an HTTP
GET
request on the target URL to retrieve an RDF representation [RDF 1.1], whose encoded RDF graph contains a relation of typehttp://www.w3.org/ns/ldp#inbox
. The subject of that relation is target and the object is the Inbox.
These may be carried out in either order, but if the first fails to result in an Inbox the second MUST be tried. Senders and consumers SHOULD omit the Link
header discovery when specifically targeting URIs with fragment identifiers.
Note
If the target contains a fragment identifier, the fragment is not part of the request to the server. Senders and consumers should be aware that any Inbox found in the Link
header will be for the resolved URL, without the fragment. See [Cool URIs for the Semantic Web - Hash URIs].
A resource MUST advertise only one Inbox. One Inbox MAY be used by multiple resources, for example using the same Inbox for replies to all of my blog posts and shares of all of my photos.
Please see Social Web Protocols for recommendations on how to carry out discovery, particularly with consideration to servers which may be unaware of this protocol.
Sender
Following discovery, senders who want to send notifications MUST deliver them through a POST
request to the Inbox URL. Senders can expect a 201 Created
(with a Location
Link header) or a 202 Accepted
in response to a successful request.
The sender MAY use an OPTIONS
request to determine the RDF content types accepted by the server, and serialize the notification in the request body according to the value of the Accept-Post
header [Accept-Post] returned. Otherwise, the body of the POST
request MUST contain the notification payload in JSON-LD with header Content-Type: application/ld+json
. The Content-Type
header MAY include a profile
URI [RFC6906].
The sender MAY include additional headers or content for the purposes of authentication or authorization e.g., Authorization: Bearer XXX
.
If the sender has any services that listen on localhost that do not require authentication, it’s possible for a malicious script to run at the Inbox endpoint that could cause the sender to make an arbitrary POST
request to itself. Senders SHOULD NOT make POST
requests to the Inbox that are localhost or a loopback IP address.
Receiver
Receivers MUST support GET
and POST
requests on the Inbox URL. In LDP terms, an Inbox is a Container.
Receiving notifications
Upon receipt of a POST
request, if the notification resource was processed successfully, receivers MUST respond with status code 201 Created
and the Location
header set to the URL from which the notification data can be retrieved (see Consumer). If the request was queued to be processed asynchronously, the receiver MUST respond with a status code of 202 Accepted
and include information about the status of the request in the body of the response.
Receivers which enforce constraints on the notifications (see Constraints) SHOULD fail to process the notification if the constraints are not met and return the appropriate 4xx
error code.
Receivers MUST accept notifications where the request body is JSON-LD, with the Content-Type: application/ld+json
, which MAY include a profile
URI [RFC6906].
Receivers MAY accept other RDF content types (e.g., text/turtle
, text/html
), and if so, SHOULD advertise the content types they accept with an Accept-Post
[Accept-Post] header in response to an OPTIONS
request on the Inbox URL.
Making Inbox contents available to consumers
A successful GET
request on the Inbox MUST return a HTTP 200 OK
with the URIs of notifications, subject to the requester’s access (returning 4xx
error codes as applicable). Receivers MAY list only URIs of notifications in the Inbox that the consumer is able to access. The Inbox URL MUST use the http://www.w3.org/ns/ldp#contains
predicate to refer to the notifications.
Each notification MUST be an RDF source. If non-RDF resources are returned, the consumer MAY ignore them. A successful GET
request on the notification URI MUST return a HTTP 200 OK
subject to the requester’s access (returning 4xx
error codes as applicable).
The JSON-LD content type MUST be available for all resources, but clients may send Accept
headers preferring other content types (RFC7231 Section 3.4 - Content Negotiation). If the client sends no Accept
header, the server may send the data in JSON-LD or any format which faithfully conveys the same information (e.g., Turtle).
Any additional description about the Inbox itself MAY also be returned (e.g., Constraints).
Note
This specification does not define a paging mechanism to serve the list of notifications in an Inbox. Implementations that wish to enable paging may want to use existing mechanisms to allow efficient retrievals e.g., Linked Data Platform Paging 1.0, Activity Streams 2.0 Collection.
Sender Verification
Receivers SHOULD verify the sender of the notification. For example:
- by having a whitelist of senders with write access to the Inbox
- requiring authentication to enforce receiver’s knowledge of every sender
- retrieving a copy of the notification from the sender’s domain to verify its origin
- checking a digital signature which accompanies the notification
Preventing Abuse
Receivers SHOULD use constraints to filter unwarranted notifications from being created on the server and exposed by the Inbox.
Receivers could consider implementing access control on the Inbox URL to restrict writing to a whitelist of trusted senders.
Consumer
Consumers retrieve the URIs of notifications in an Inbox through making a GET
request on the Inbox URL (to find this URL, see discovery).
The URIs of the notifications MUST be discoverable through the http://www.w3.org/ns/ldp#contains
predicate of the Inbox URL (see example for Inbox content).
When retrieving the Inbox or the individual notifications, the consumer SHOULD explicitly set the Accept
header to indicate preferred content types, including for JSON-LD. Fetching the individual notifications — if any, how many, or according to a particular criteria (e.g., content-length, timestamp) — is at the discretion of the consumer.
The consumer MAY include additional headers or content for the purposes of authentication or authorization.
Consumers MAY perform additional fetching or inferring of information from the payload (e.g., dereferencing resources referenced in the notification to fetch their contents) at their discretion. Consumers MAY also want to check the notifications against any constraints as announced by an Inbox before further processing or use.
Note
The fetched URI for a notification may contain RDF statements with one or more subject IRIs different from the requested URI itself. Consumers should also not assume that the notification contains any triples with the requested URI as the subject. This is also pertinent when the body of the notification uses relative IRIs. Implementations may wish to treat notification URIs as graphs which contain the RDF from the notification payload.
Note
Consumers should be aware that anything can be posted to an Inbox (depending on restrictions in place by the receiver, which are not defined by this protocol), so when it comes to making use of notification data consumers may want to take precautions when ascertaining the veracity of the contents.
Payload
The payload of the notification MUST be JSON-LD unless another RDF syntax has been negotiated with the receiver. To allow for a wide variety of use cases, the actual vocabulary of the payload is deliberately not specified here.
Payload Examples
This section is non-normative.
A notification may contain arbitrary information, including references to multiple resources with their own URIs, without necessarily referring to one particular external resource or origin for the data. The receiver is expected to return all triples that were initially sent when such a notification is requested by a consumer.
Security, Privacy and Content Considerations
This section is non-normative. Normative requirements for security and privacy are called out in the section of the specification to which they are most applicable.
Constraints
Inbox URLs can announce their own constraints (e.g., SHACL, Web Annotation Protocol) via an HTTP Link
header or body of the resource with a rel
value of http://www.w3.org/ns/ldp#constrainedBy
. Senders should comply with constraint specifications or the receiver may reject their notification and return an appropriate 4xx
error code.
Target Ownership
Publishers of the resources advertising an Inbox (target) should do so on a server they trust. Publishers must be aware that third-party access to headers or content could result in notifications being redirected.
Subscribing to Notifications
This specification describes how consumers can read notifications from a receiver through pull, however consumers may want to ask to have incoming notifications or changes to Inbox’s contents pushed to them. Similarly, receivers may wish to make a request for notifications from a particular sender. This kind of subscription mechanism is left out of scope, but senders, receivers and consumers are not prohibited from making such an arrangement. Implementations that wish to enable subscribing may want to use existing mechanisms e.g., ActivityPub, WebSub, The WebSocket Protocol, HTTP Web Push.
Activity Streams 2.0 Support
Receiver implementations that wish to support Activity Streams 2.0 Core can see Social Web Protocols - Inbox Interop for Content-Type and vocabulary equivalences.
Natural Language Content
Building an international base of users is important in a federated network. Some LDN interactions can return content with natural language text, such as HTML fragments, or summary fields. Providing multiple language representations of each item might not be feasible in all circumstances. Implementations are encouraged to provide means of discovering the available languages and/or negotiating the language returned, such as using the HTTP Accept-Language
header to negotiate and select the most appropriate language representation to send for a given request.
Authenticated Inboxes
If a receiver expects senders or consumers to authenticate, it should check the validity of their credentials before returning any other data, including other error codes. For example, the receiver should not first check for the existence of the inbox and return 404 Not Found
if the requester has not been verified.
Authentication involving token passing must be done over HTTPS.
Security and Privacy Review
These questions provide an overview of security and privacy considerations for this specification as guided by Self-Review Questionnaire: Security and Privacy.
- Does this specification deal with personally-identifiable information?
- Notification payloads may contain any data including that which identifies the sender or the receiver. Access to notification data is under the control of the receiver. In the case of sending sensitive information, the sender should be aware that the receiver may implement access control on the Inbox that allows for public reading of the contents.
- Does this specification deal with high-value data?
- Same implications as personally-identifiable information in notification payload (as mentioned above).
- Does this specification introduce new state for an origin that persists across browsing sessions?
- No.
- Does this specification expose persistent, cross-origin state to the web?
- No.
- Does this specification expose any other data to an origin that it doesn’t currently have access to?
- No.
- Does this specification enable new script execution/loading mechanisms?
- No.
- Does this specification allow an origin access to a user’s location?
- No.
- Does this specification allow an origin access to sensors on a user’s device?
- No.
- Does this specification allow an origin access to aspects of a user’s local computing environment?
- No.
- Does this specification allow an origin access to other devices?
- No.
- Does this specification allow an origin some measure of control over a user agent’s native UI?
- No.
- Does this specification expose temporary identifiers to the web?
- No.
- Does this specification distinguish between behavior in first-party and third-party contexts?
- No.
- How should this specification work in the context of a user agent’s "incognito" mode?
- Works in such a way that the website would not be able to determine that the user was in "incognito".
- Does this specification persist data to a user’s local device?
- No.
- Does this specification have a "Security Considerations" and "Privacy Considerations" section?
- :)
- Does this specification allow downgrading default security characteristics?
- No.
Exit Criteria
This specification advanced to Proposed Recommendation with at least two independent, interoperable implementations of each feature. Each feature was implemented by a different set of products. There was no requirement that all features needed to be implemented by a single product.
- Independent implementations are developed by different parties and cannot share, reuse or derive form another qualifying implementation code which is directly pertinent to the implementation of this specification.
- Interoperability occurs between senders and receivers, or between consumers and receivers, when the sender/consumer makes a request to the receiver, and the receiver sends the expected response, as defined by this specification.
- An implementation is an LDN sender, receiver or consumer which implements the corresponding conformance class of the specification.
For the purposes of evaluating exit criteria, each of the following was considered a feature:
- Advertising the Inbox of a given resource through the
Link
header. - Advertising the Inbox of a given resource through the body of the resource.
- Sending a notification to the Inbox of a given target.
- Receiving a notification and responding with the appropriate status code according to how it was processed and if it was accepted. Responding to
GET
requests on the Inbox with the Inbox listing, and responding toGET
requests on the individual notifications with their representations. - Reading the Inbox listing of a given target.
- Reading the individual notifications in the Inbox of a given target.
Acknowledgements
We would like to thank and acknowledge the following people for their contributions to this specification:
- Aaron Coburn
- Addison Phillips
- Adrian Pohl
- Albert Meroño Peñuela
- Alex Kearney
- Andrei Vlad Sambra
- Andreas Kuckartz
- Bart van Leeuwen
- Benjamin Goering
- Benjamin Young
- Bernadette Hyland
- Chris Webber
- Christian M. Amsüss
- Dan Brickley
- Dmitri Zagidulin
- Erik Wilde
- Fabien Gandon
- Felix Sasaki
- Graham Klyne
- Henry Story
- Jeffrey Witt
- John Klensin
- Kingsley Idehen
- Kjetil Kjernsmo
- Melvin Carvalho
- Natanael Arndt
- Nick Smith
- Nicola Greco
- Nuno Freire
- Raphaël Troncy
- Richard Ishida
- Rob Sanderson
- Sandro Hawke
- Stian Soiland-Reyes
- Tim Berners-Lee
- Xavier Sumba
Change Log
This section is non-normative.
REC-ldn-20170502 ← PR-ldn-20170321 ← CR-ldn-20170223 ← CR-ldn-20161101 ← WD-ldn-20161011 ← WD-ldn-20160926 ← WD-ldn-20160913 ← WD-ldn-20160824 ← WD-ldn-20160726
Changes from 21 March 2017 PR to this version
- Fix a syntax error in an example
- Add 'in reply to' link to Social Web Group Charter
- Add links to past versions of the spec
- Update references
Changes from 23 February 2017 CR to 21 March 2017 PR
- Update acknowledgements
Changes from 1 November 2016 CR to 23 February 2017 CR
- Add Acknowledgements
- Clarify the implied response codes for notifications and request URI in note
- Update references
Changes from 11 October 2016 WD to 1 November 2016 CR
- Add Natural Language Content section under Considerations
- Fix reference to PubSub
- Add URLs to implementation reports and test suite
- Add legend to SVG
- Fix AS2 bib fragment
- Reword payload verification
- Added 'Authenticated Inboxes' security guidance
Changes from 26 September 2016 WD to 11 October 2016 WD
- Add and update examples
- Improve discovery wording for HTTP HEAD/GET
- Editorial; grammar, paraphrasing
- Fix Accept-Post reference and be explicit about its appearance in OPTIONS
- Integrate feedback from internationalisation review (examples)
Changes from 13 September 2016 WD to 26 September 2016 WD
- Fix typos and links
- Reorder sections to Sending, Receiving, Consuming
- Update examples
- Add reference to RFC7231
- Clarify wording for URI discovery
- Add sub-headings for the non-normative sections under Considerations
- Add overview diagram
- Add non-normative sub-section for Retry Discovery under Considerations
- Mention being courteous for Discovery
- Move Preventing Abuse to respective normative sections
- Move Sender Verification to go under Receiving
- Move ActivitStreams 2.0 Support to Considerations
- Move Payload Verification to Consuming as a Note
- Move normative and some non-normatives from Considerations to earlier sections
- Add Security and Privacy Review section
- Update Introduction
Changes from 24 August 2016 WD to 13 September 2016 WD
- Typos, punctuation, naming
- Add Exit Criteria
- Clarify behaviour when Accept header is used and omitted
- Add a note about subject of the relation for the Link header field
- Add GET for possible Link header, clarify subject URI (for its Inbox) in target URL
- Revise Abstract
- Add consideration about target ownership
- Mention 'any resource can have its own inbox'
- Add Subscribing to Notifications section
Changes from 27 July 2016 WD to 24 August 2016 WD
- Improve examples; update, syntactical fixes, @context in https
- Typos, punctuation, naming
- Use informative discretion about the payload
References
Normative References
- [ldp]
- Steve Speicher; John Arwe; Ashok Malhotra. W3C. Linked Data Platform 1.0. 26 February 2015. W3C Recommendation. URL: https://www.w3.org/TR/ldp/
- [rdf11-concepts]
- Richard Cyganiak; David Wood; Markus Lanthaler. W3C. RDF 1.1 Concepts and Abstract Syntax. 25 February 2014. W3C Recommendation. URL: https://www.w3.org/TR/rdf11-concepts/
- [rfc2119]
- S. Bradner. IETF. Key words for use in RFCs to Indicate Requirement Levels. March 1997. Best Current Practice. URL: https://tools.ietf.org/html/rfc2119
- [rfc6906]
- E. Wilde. IETF. The 'profile' Link Relation Type. March 2013. Informational. URL: https://tools.ietf.org/html/rfc6906
Informative References
- [accept-post]
- Steve Speicher; John Arwe; Ashok Malhotra. W3C. The Accept-Post Response Header (Linked Data Platform 1.0). 26 February 2015. W3C Recommendation. URL: https://www.w3.org/TR/ldp/#header-accept-post
- [activitypub]
- Christopher Webber; Jessica Tallon; Owen Shepherd. W3C. ActivityPub. 13 April 2017. W3C Candidate Recommendation. URL: https://www.w3.org/TR/activitypub/
- [activitystreams-core]
- James Snell; Evan Prodromou. W3C. Activity Streams 2.0. 13 April 2017. W3C Proposed Recommendation. URL: https://www.w3.org/TR/activitystreams-core/
- [annotation-protocol]
- Robert Sanderson. W3C. Web Annotation Protocol. 23 February 2017. W3C Proposed Recommendation. URL: https://www.w3.org/TR/annotation-protocol/
- [cooluris]
- Leo Sauermann; Richard Cyganiak. W3C. Cool URIs for the Semantic Web. 3 December 2008. W3C Note. URL: https://www.w3.org/TR/cooluris
- [ldp-paging]
- Steve Speicher; John Arwe; Ashok Malhotra. W3C. Linked Data Platform Paging 1.0. 30 June 2015. W3C Note. URL: https://www.w3.org/TR/ldp-paging/
- [websub]
- Julien Genestoux; Aaron Parecki. W3C. WebSub. 11 April 2017. W3C Candidate Recommendation. URL: https://www.w3.org/TR/websub/
- [rfc6455]
- I. Fette; A. Melnikov. IETF. The WebSocket Protocol. December 2011. Proposed Standard. URL: https://tools.ietf.org/html/rfc6455
- [rfc7231]
- R. Fielding, Ed.; J. Reschke, Ed.. Hypertext Transfer Protocol (HTTP/1.1): Semantics and Content. June 2014. Proposed Standard. URL: https://tools.ietf.org/html/rfc7231
- [security-privacy-questionnaire-20151210]
- Mike West. W3C. Self-Review Questionnaire: Security and Privacy. 10 December 2015. W3C Note. URL: https://www.w3.org/TR/2015/NOTE-security-privacy-questionnaire-20151210/
- [shacl]
- Holger Knublauch; Dimitris Kontokostas. W3C. Shapes Constraint Language (SHACL). 2 February 2017. W3C Working Draft. URL: https://www.w3.org/TR/shacl/
- Amy Guy. W3C. Social Web Protocols. 2 November 2016. W3C Working Draft. URL: https://www.w3.org/TR/social-web-protocols/
- [webpush]
- M. Thomson; E. Damaggio; B. Raymor. IETF. Generic Event Delivery Using HTTP Push. December 2016. Proposed Standard. URL: https://tools.ietf.org/html/rfc8030
Social Web Working Group
LDN is one of several related specifications being produced by the Social Web Working Group. Implementers interested in alternative approaches and complimentary protocols should start by reading the overview document Social Web Protocols. Specific subsections of Social Web Protocols are referenced throughout this specification to highlight points of extensibility or interoperability with other protocols.