Skip To Content

Add a Feature to a Spatiotemporal Big Data Store

The Add a Feature to a Spatiotemporal Big Data Store Output Connector can be used to save event data, as feature records, to a spatiotemporal big data store. This type of connector only supports adding new feature records to hosted map and feature services published to an ArcGIS Enterprise portal whose hosting server has a registered spatiotemporal big data store - a data store type available with ArcGIS Data Store.

Client web mapping applications access feature records stored in a spatiotemporal big data store through hosted map and feature services which offer data aggregation and visualization capabilities specific to this type of enterprise geodatabase. For information on how specific data aggregation capabilities are configured, see Aggregation Renderer Map Service Specification.

Usage notes

  • This output connector supports the addition of new feature records to a spatiotemporal big data store enterprise geodatabase.
  • The outbound connector pairs a No Operation Outbound Adapter with the Spatiotemporal Big Data Store Outbound Transport. All event record formatting, caching, enterprise geodatabase connection, and feature creation operations are handled by the outbound transport.
  • Client web mapping applications access feature records stored in a spatiotemporal big data store through hosted map and feature services.
  • ArcGIS GeoEvent Server must have a registered server connection whose type is ArcGIS Enterprise, also known as a Portal type connection, in order to obtain connection information from an ArcGIS Enterprise portal's registered spatiotemporal big data store. A direct connection is made from GeoEvent Server to the spatiotemporal big data store enterprise geodatabase to add and/or update feature records in a spatiotemporal big data store.
  • The Register ArcGIS Server capability, available when configuring a new output, allows you to register a connection to a standalone ArcGIS Server, an ArcGIS Enterprise hosting server, or the hosting server used by your ArcGIS Online organization. Only an ArcGIS Enterprise type connection, however, will allow the output connector to interface with a spatiotemporal big data store.
  • The Create Data Source capability, available when configuring a new output, allows you to create a new spatiotemporal big data store data source. Like publishing a new feature service, the ability to create a new data source requires an existing GeoEvent Definition which reflects the attribute fields and schema you want feature records to exhibit. Note that the GeoEvent Definition you use must honor restrictions imposed by this type of enterprise geodatabase and the data source schema cannot be changed once it has been created. Unlike traditional map/feature services, multiple hosted map and feature services can be published which use the same spatiotemporal big data store data source. These hosted map/feature services provide unique data aggregation and visualization capabilities as well as RESTful access to the feature records held in the spatiotemporal big data store.
  • Any spatiotemporal big data store data source you create using GeoEvent Manager will initially be empty. Use GeoEvent Server to add and/or update feature records in the data source with data from real-time feeds processed through a GeoEvent Service.
  • A spatiotemporal big data store data source cannot be created for an ArcGIS Online organization or an ArcGIS Server which is not an ArcGIS Enterprise portal's hosting server. For more information on working with the spatiotemporal big data store in GeoEvent Server, see the Spatiotemporal Big Data Store Tutorial.

Parameters

ParameterDescription

Name

A descriptive name for the output connector used for reference in GeoEvent Manager.

GeoEvent Definition

The name of an existing GeoEvent Definition to use when adapting received data to create event data for processing by a GeoEvent Service.

Note:
The schema of the GeoEvent Definition specified must mirror the schema of the spatiotemporal big data store data source. Any fields whose name has changed (field names are case-sensitive) will cause the Spatiotemporal Big Data Store Outbound Transport to log a warning that the specified GeoEvent Definition is incompatible with the data source. When processed event records are sent to the output, an error message will likely be either logged or displayed by the output connector that one or more expected attribute fields are missing. Event records will not be added or updated in the spatiotemporal big data store data source until the specified GeoEvent Definition correctly represents all expected attribute names. This includes capitalization errors such as Geometry vs. geometry.

ArcGIS Server Connection

The ArcGIS Enterprise connection registered with ArcGIS GeoEvent Server as a data store. The ArcGIS Enterprise connection must have a hosting server configured with the ArcGIS Data Store enabled as a spatiotemporal big data store. Registered server connections cache information about map/feature services, their layers, and layer properties.

Data Source Name

The name of the data source in the spatiotemporal big data store to which processed event records will be saved as feature records.

Flush Interval (milliseconds)

Specifies how often (in milliseconds) event records will be added as feature records in the designated spatiotemporal big data store data source. The default is 1000 milliseconds, which means processed event records will be added to the data source as new records every second.

Maximum Features Per Transaction

The maximum number of records to include in any single feature service request to add feature records. If the outputs cache contains more than the specified maximum number of records, multiple requests will be made until the outputs cache has been emptied. The default is 1000.

As a best practice, balance the size and complexity of each event record against the number of event records processed each second. When event records are particularly large, with many attribute fields and/or large complex geometry objects, reduce the value to avoid sending requests which are larger than a feature service can handle. However, depending on the velocity and volume of event records being processed each second, setting a value too low could result in an overwhelming number of transaction requests.

Write Concurrency Level

Specifies the number of concurrent writers (or threads) that will be writing in parallel when sending records to the spatiotemporal big data store. The spatiotemporal big data store is capable of handling multiple threads; increased throughput can be achieved by adjusting the write concurrency level. The default is 3.

The effectiveness of the Write Concurrency Level property depends on a multitude of factors such as the volume of data being written, the size of each event record, the speed of the network, and the compute capacity of each machine. While adjusting this property can result in improved event record throughput, it should not be casually changed without considering the aforementioned factors. Settings specified for Flush Interval and Maximum Features Per Transaction should also be considered.


In this topic
  1. Usage notes
  2. Parameters