Difference between revisions of "Reference Data"

From Open Rail Data Wiki
Jump to navigation Jump to search
(→‎Downloading the data: Update BPLAN data link)
m (Added info on the raw TPS data)
(6 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
{{DISPLAYTITLE:Reference Data}}
 
{{DISPLAYTITLE:Reference Data}}
 
 
Three sets of reference data are available from Network Rail.  The ''All Reference Data'' topic must be selected and subscribed to in the ''My Feeds'' tab of the data feeds site to be able to access the CORPUS and SMART data.  The Train Planning data is available from this site.  See the [[About_the_feeds|about the feeds]] page for more details.
 
Three sets of reference data are available from Network Rail.  The ''All Reference Data'' topic must be selected and subscribed to in the ''My Feeds'' tab of the data feeds site to be able to access the CORPUS and SMART data.  The Train Planning data is available from this site.  See the [[About_the_feeds|about the feeds]] page for more details.
  
Line 146: Line 145:
 
An in-depth [[SmartBerthDetail|overview of how to use SMART data]] is available.
 
An in-depth [[SmartBerthDetail|overview of how to use SMART data]] is available.
  
= Train Planning Data =
+
= BPLAN Geography =
 
 
The Train Planning data contains several sets of reference and geographic data:
 
 
 
* '''Reference''': Reference codes and Timing Loads
 
* '''Geographic Data''': Locations, Platforms, Network and Timing Links
 
  
== Downloading the data ==
+
Twice a year, [[BPLAN_Geography|a set of geographical data]] is released from Network Rail which contains data to be used when planning trains.  It also includes other data, such as platform numbers at stations, and details of activity codes used in CIF.
  
The latest version of the data from [[Media:20180520_ReferenceData.gz|20th May 2017 is available]], as well as the previous versions from [[Media:20170830_ReferenceData.gz|30th August 2017 is available]] and [[Media:20170127_ReferenceData.gz|27th January 2017]]. This data will be updated twice a year.
+
The data is available [[BPLAN_Geography_Data|on a separate page]].
 
 
Documentation on the [[Train_Planning_Data_Structure|data structure]] is available.
 
  
 
= Train Planning Network Model =
 
= Train Planning Network Model =
Line 167: Line 159:
 
To download the data, visit http://datafeeds.networkrail.co.uk/ntrod/SupportingFileAuthenticate?type=TPS
 
To download the data, visit http://datafeeds.networkrail.co.uk/ntrod/SupportingFileAuthenticate?type=TPS
  
Download the Schema for the TPS Data Schema from [[Media:TPS_Schema.xsd.gz| here]]
+
The raw data is XML in tarred bzip2 (tar.bz2) format
 +
 
 +
The current schema for the Network Model is available [[Media:TPS_Schema_20200818.xsd.gz|here]].
 +
 
 +
The previous schema, valid until an unknown date in 2020, is available [[Media:TPS_Schema.xsd.gz|here]].
  
 
= Other Sources =
 
= Other Sources =
  
 
* [http://www.railwaycodes.org.uk/index.shtml Phil Deaves] has compiled a reference site listing location codes (CRS, STANOX and TIPLOC) as well as a comprehensive listing of other railway codes
 
* [http://www.railwaycodes.org.uk/index.shtml Phil Deaves] has compiled a reference site listing location codes (CRS, STANOX and TIPLOC) as well as a comprehensive listing of other railway codes
* [http://trains.barrycarlyon.co.uk/data/locations/ http://trains.barrycarlyon.co.uk/data/locations/] provides a searchable list of locations with their CRS, STANOX and TIPLOC codes and offers a downloadable SQL dump of the data
 
 
* [http://data.gov.uk/dataset/naptan NaPTAN] (National Public Transport Access Nodes) is provided by the Department for Transport and is the single government source for all public transport stops/stations in the UK, also including bus stops, ferry terminals, airports, metro stations, and heritage railways, as well as associated metadata, including the location of entrances to stations, and platform locations in some circumstances. Contains ATCO, CRS and TIPLOC codes and latitude/longitudes.
 
* [http://data.gov.uk/dataset/naptan NaPTAN] (National Public Transport Access Nodes) is provided by the Department for Transport and is the single government source for all public transport stops/stations in the UK, also including bus stops, ferry terminals, airports, metro stations, and heritage railways, as well as associated metadata, including the location of entrances to stations, and platform locations in some circumstances. Contains ATCO, CRS and TIPLOC codes and latitude/longitudes.
* Peter Hicks at [http://www.opentraintimes.com/ OpenTrainTimes] has written a [http://stash.poggs.com/reference_data_relationships.pdf a useful guide to the relationships between different datasets] which gives a good overview of the way that different sets of data interact
 
* [http://www.safety.networkrail.co.uk/Services/Jargon-Buster Network Rail Jargon Buster] - a good range of definitions for railway technical terms.
 
  
 
{{Navtable-DataFeeds}}
 
{{Navtable-DataFeeds}}

Revision as of 09:11, 23 February 2021

Three sets of reference data are available from Network Rail. The All Reference Data topic must be selected and subscribed to in the My Feeds tab of the data feeds site to be able to access the CORPUS and SMART data. The Train Planning data is available from this site. See the about the feeds page for more details.

Other useful reference sources are also listed.

CORPUS: Location Reference Data

This is provided from the CORPUS system (Codes for Operations, Retail & Planning – a Unified Solution). The data is a periodically-updated snapshot of the CORPUS database. This can be used to translate STANOX, TIPLOC, NLC, UIC and 3-alpha (CRS) codes to location descriptions.

Downloading CORPUS Data

To download the data, visit http://datafeeds.networkrail.co.uk/ntrod/SupportingFileAuthenticate?type=CORPUS

CORPUS Data Format

CORPUS data is supplied as a plain text file containing a JSON representation of the data. Entries comprise the following fields (not all fields may contain data):

Field Description
STANOX STANOX code
UIC UIC code
3ALPHA 3-letter location code
TIPLOC TIPLOC code
NLC NLC code
NLCDESC Description of the NLC
NLCDESC16 NLC description (16-character version)

SMART: Berth Stepping Data

The SMART database contains details of train describer berths and allows movements into berths to be translated into arrivals and departures from locations. The data feed contains a periodically-updated snapshot of the SMART database.

Downloading SMART Data

To download the data, visit http://datafeeds.networkrail.co.uk/ntrod/SupportingFileAuthenticate?type=SMART

SMART Data Format

SMART data is supplied as a plain text file containing a JSON representation of the data. Entries comprise the following fields (not all fields may contain data):

Field Description
TD Train describer area
FROMBERTH TD berth that movement is from
TOBERTH TD berth that movement is to
FROMLINE Line which the movement is from
TOLINE Line which the movement is to
BERTHOFFSET Difference between the time the berth event occurs and the time to be recorded in TRUST, in seconds
PLATFORM Platform
EVENT One of A, B, C, D
ROUTE
STANOX STANOX code for location
STANME Abbreviated description of location
STEPTYPE One of B, F, C, D, I, T, E
COMMENT
EVENT Description
A Arrive Up
B Depart Up
C Arrive Down
D Depart Down
STEPTYPE Description
B Between
F From
T To
D Intermediate First
C Clearout
I Interpose
E Intermediate

An in-depth overview of how to use SMART data is available.

BPLAN Geography

Twice a year, a set of geographical data is released from Network Rail which contains data to be used when planning trains. It also includes other data, such as platform numbers at stations, and details of activity codes used in CIF.

The data is available on a separate page.

Train Planning Network Model

The Train Planning Network Model contains very detailed information on the network model used by ITPS, the Integrated Train Planning System.

Downloading the data

To download the data, visit http://datafeeds.networkrail.co.uk/ntrod/SupportingFileAuthenticate?type=TPS

The raw data is XML in tarred bzip2 (tar.bz2) format

The current schema for the Network Model is available here.

The previous schema, valid until an unknown date in 2020, is available here.

Other Sources

  • Phil Deaves has compiled a reference site listing location codes (CRS, STANOX and TIPLOC) as well as a comprehensive listing of other railway codes
  • NaPTAN (National Public Transport Access Nodes) is provided by the Department for Transport and is the single government source for all public transport stops/stations in the UK, also including bus stops, ferry terminals, airports, metro stations, and heritage railways, as well as associated metadata, including the location of entrances to stations, and platform locations in some circumstances. Contains ATCO, CRS and TIPLOC codes and latitude/longitudes.


Network Rail Open Data Feeds
Data Feeds About the Feeds Account States Durable Subscriptions Example Code ( PHP / C# / Java / Ruby / Node.js) • Advanced UsesFAQ Release Notes
RTPPM RTPPM Feed
Train Movements Train Movements Feed Train Activation Train Cancellation Train Movement Train Reinstatement Change of Origin Change of Identity Change of Location TSPEED Field Planned Cancellations Cancellation Codes
TD TD Feed C-Class Messages S-Class Messages Train Describers TD Berths
VSTP VSTP Feed
TSR TSR Feed Route Codes
SCHEDULE SCHEDULE Feed Schedule and Location Records Association Records CIF Codes How Scheduling Works Allowances
Reference Data Reference Data Feed TOC Codes CIF Codes Delay Attribution Codes Identifying Locations (STANOX, TIPLOC, NLC and 3-Alpha Codes) STANOX Geographical Areas Train Planning data