SQLstream Concepts
s-Server Overview
SQLstream Objects
Stream and View
Differences from RDBMS tables
Plugins
Pump
ROWTIME
High Availability through Parallel Redundancy and Checkpointing
Time and Streaming Data
Complex Event Processing
Rowtime Bounds
Application Design Considerations
Queries That Run Forever
Pumps, Streams, and Processing Pipelines
Aggregation Windows
Advanced Stream Resequencing with SQLstream
Troubleshooting Processing Delays
Transforming and Analyzing Data in s-Server
Application Model
Correctness Mode
Installing SQLstream
SQLstream Components Overview
SQLstream s-Server Licensing
Installing s-Server on Linux
Using the SQLstream Cover Page
Running SQLstream on Docker
Installing SQLstream on Parallels
Using the AWS Marketplace SQLstream AMI
Installing the SQLstream AMI
Installing the SQLstream Azure MI
Installing the SQLstream Virtual Hard Disk
Installing the SQLstream Trial VM Appliance
Installing SQLstream StreamLab on Linux
Starting and Stopping s-Server Manually
Installing s-Studio and Client Tools as Standalone Packages
Troubleshooting Installation
Installation Guide Appendix
Appendix: Managing s-Server as a Service
Appendix: SQLstream s-Server Installation Directories
Appendix: Upgrading SQLstream s-Server
Appendix: Network Configuration Issues for s-Server
Appendix: Running Multiple Instances of s-Server
Appendix: Setting Up Environment Variables & Path
Appendix: SQLstream s-Server Authentication
Appendix: Installing the MySQL Driver
What's Next?
Building Streaming Applications
Tutorial 1: Introduction to StreamLab
Tutorial 2: Introduction to Coding with Streaming SQL
Tutorial 3: Using a Pump
Tutorial 4: Creating a View
The Linear Road Benchmark
Introduction to Pipelines
Pipelines as Microapps
Supplying Info to Containers
Integrating SQLstream with Other Systems
s-Server Integrations
Full List of Plugins and Agents
Embedding SQLstream
Using the Extensible Common Data Framework
Using the ECD Agent
File-based T-Sort
Using Exactly Once Semantics
Reading Data into s-Server
Parser Types for Reading
Parsing CSV
Parsing JSON
Parsing XML
Parsing ProtoBuf
Parsing Avro
Parsing Key Value Pairs
Using the None Parser
Using the Discovery Parser
Writing Data Out of s-Server
Output Formats for Writing
Formatting Data as Avro
Formatting Data as BSON
Formatting Data as CSV
Formatting Data as JSON
Formatting Data as ORC
Formatting Data as XML
Integrating ADLS Gen2 (ABFS)
Integrating AMQP
Integrating Azure Event Hubs
Integrating Cassandra
Integrating DataRobot
Integrating the File System
Integrating Files using VFS
Integrating Hadoop
Integrating Hive Tables
Integrating HTTP
Integrating IBM MQ
Integrating Kafka
Integrating Kinesis
Integrating Mail Servers
Integrating MongoDB
Integrating MQTT
Integrating Netflow
Integrating Prometheus Pushgateway
Integrating Pulsar
Integrating RDBMS Systems
Integrating Snowflake
Integrating Sockets
Integrating WebSockets
Using s-Server over the Internet
Guavus SQLstream Software Development Kit
SQLstream Java SDK
Writing a Java UDF
Writing a Java UDX
Writing an ECD Plugin
Sample Code for Source Plugin
Sample Code for Parser
SQLstream JDBC Driver
StreamingPreparedStatement
StreamingResultSet
StreamingStatement
SQLstream Python SDK
Writing a Python UDX
SQLstream C++ SDK
Installing the C++ SDK
Writing a C++ UDA
Writing a C++ UDF
Analyzing Data in s-Server
Writing Streaming SQL Queries
More Complex SQL Examples
Windowed Aggregation on Streams
Using Pumps to Create Processing Pipelines
Creating Streaming JOINs
Query Patterns
Running Demo Applications and Data
Using UDXs and UDFs for Analysis
Transforming Data
AesEncryptDecrypt UDX
Avro Formatter UDX
GeoIPFunctions UDX
GoogleGeoCode UDF
Group Rank UDX
Kalman Filter UDX
Linear Interpolation UDX
Matched Filter UDX
Parser UDX
Quadratic Interpolation UDX
Table Lookup UDX
Throttle UDX
URI Parse UDX
XML Parse UDX
The Mochi Demo
The Hamachi Demo
Generating Test Data with DataGen
Using MTSQL
Using StreamLab
Installing and Running Streamlab on Linux
StreamLab Gallery
Working with Projects
Using StreamLab Sources
Adding an External Stream Source
Configuring External Stream Sources
Adding an External Table Source
Adding an s-Server Stream Source
Editing Source Columns
Verifying a Source by Sampling Rows
Throttling a Source
Working with Partitioned Sources
StreamLab External Connections Overview
StreamLab Pipeline Guides Overview
Advanced Commands
Analytics
Basic Commands
Categorize
Custom View
Customizing the Scrutinizer
Distinct
Duplicate
Filter
GroupRank
Join
Join Pipeline
Managing the Scrutinizer
New Column
Parsers
Partition Window
Pivot
Split Pipeline
Timestamp
Turning off the Scrutinizer
Union
Window
Using StreamLab Sinks
Adding an External Stream Sink
Configuring External Stream Sinks
Adding an External Table Sink
Adding a SQLstream Stream Sink
Creating a New SQLstream Stream as a Sink
Editing Sink Columns
Routing Data to a Sink
StreamLab Dashboards
Generating Dashboards in StreamLab
Modifying Dashboard Layouts
Creating Collections
Creating Custom Dashboards
Bar Graph
Bars and Lines
Bars Over Time
Bollinger Bands
Creating a Line Plot Panel
Map and Table Dashboard
Parallel Coordinates
Scatter Matrix
Time Series
Customizing the SELECT Template
Locking Dashboards
Using Preferences to Change Panel Appearance and Input
Troubleshooting StreamLab
Running WebAgent
HTTPS for StreamLab
Using the Rose API
Using s-Dashboard
s-Dashboard Input Overview
Types of Layouts
Dashboard Layouts
Integrating Panels
View Stream as a Table
View Latest Row Panels
View Rows Over Time Panels
View Rows Over a Key Column Panels
Geographical and 3D Stream Panels
Creating a Custom Panel in s-Dashboard Using Chart_js
Creating a Custom Panel in s-Dashboard Using SVG
Using the Inter Panel Blackboard
Creating a Custom Panel in s-Dashboard Using Vega
Panel Development Process
Using Panel Preferences
Using the Mochi Demo
Running WebAgent
Running s-Dashboard
Troubleshooting s-Dashboard
Appendix A: Map IDs for Choropleth
Using SQLLine
Using sqlLineRemote to Connect to a Database
Using s-Studio
Connecting to s-Server
Inspecting s-Server Objects in s-Studio
Creating Objects in s-Studio
Integrating SQL in s-Studio
Managing s-Server through s-Studio
Administering s-Server
Starting and Stopping s-Server
Configuring Networking for s-Server
Configuring s-Server Parameters
Using and Managing Trace Files
Session Management
Implementing Federation for s-Server
Monitoring s-Server and Components
Using Telemetry to Monitor Performance
Running Multiple Instances of s-Server
Autoprovisioning s-Server
Maintaining s-Server
Hardening s-Server
Sandboxing in s-Server
s-Server Streaming SQL Reference Manual
Extensions to the SQL standard
Temporal Predicates
Error Handling
Basic Building Blocks
Catalog Objects
Objects within a Schema
Data Types
Expressions and Literals
Identifiers
Monotonic Expressions and Operators
Condition Clause
Common Clauses
Run-Time Context
User Defined Session Variables
Operators
Date, Timestamp, and Interval Operators
Logical Operators
String Operators
Built-in Functions
Aggregate Functions
Analytic Functions
Conversion Functions
Date / Time Functions
Date and Time Patterns
Statistical Variance and Deviation Functions
Scalar Functions
ABS
ANY and EVERY
AVG
CAST
CEIL / CEILING
CHAR_LENGTH / CHARACTER_LENGTH
CHAR_TO_DATE
CHAR_TO_TIME
CHAR_TO_TIMESTAMP
COALESCE
COUNT
CURRENT_DATE
CURRENT_PATH
CURRENT_ROW_TIMESTAMP
CURRENT_TIME
CURRENT_TIMESTAMP
DATE_TO_CHAR
DATEDIFF
EXP
EXP_AVG
EXTRACT
FAST_REGEX_LOG_PARSER
FIRST_VALUE
FIXED_COLUMN_LOG_PARSE
FLOOR
INITCAP
LAG
LAST_VALUE
LISTAGG
LN
LOCALTIME
LOCALTIMESTAMP
LOG10
LOWER
MAX
MILLIS_TO_TIMESTAMP
MIN
MOD
Monotonic Function
NTH_VALUE
NULLIF
OVERLAY
POSITION
POWER
REGEX_LOG_PARSE
REGEX_REPLACE
SESSION_USER
STDDEV_POP
STDDEV_SAMP, STD_DEV
STEP
SUBSTRING
SUM
SYS_LOG_PARSE
TIME_TO_CHAR
TIMESTAMP_TO_CHAR
TO_TIMESTAMP
TRIM
TSDIFF
UNIX_TIMESTAMP
UPPER
VAR_POP
VAR_SAMP
VARBINARY_TO_STRING
VARBINARY_TO_VARCHAR
VARCHAR_TO_VARBINARY
VARIABLE_COLUMN_LOG_PARSE
W3C_LOG_PARSE
Utility Functions
IS_VALID_IP_ADDRESS
PING
General Management Functions
BROWSE_CONNECT_FOREIGN_SERVER
BROWSE_TABLE
COMPLETE_SQL
DATA_RATE_RPS
FORMAT_SQL
GENERATE_DDL_FOR_CATALOG
GENERATE_DDL_FOR_JAR
GENERATE_DDL_FOR_SCHEMA
GENERATE_DDL_FOR_SERVER
GENERATE_DDL_FOR_TABLE
GENERATE_DDL_FOR_USER
GENERATE_DDL_FOR_WRAPPER
GET_KEYWORDS
GET_OBJECT_DDL
GET_PLUGIN_PROPERTY_INFO
GET_TABLE_TYPE_BY_MOF_CLASS_NAME
GETÂ SERVER_PROPERTY_INFO
IS_VALID_SQL
OBJECTS_IN_USE
PERFORMANCE_COUNTERS
REPOSITORY_INTEGRITY_VIOLATIONS
REPOSITORY_PROPERTIES
SESSION_PARAMETERS
SESSIONS
SETTRACELEVEL
STATEMENTS
SYSTEM_INFO
SYSTEM_USER
THREAD_STACK_ENTRIES
THREADS
VALIDATE_SQL
ALTER statements
ALTER PUMP
ALTER SESSION
ALTER STREAM
ALTER SYSTEM
ALTER USER
CALL
CREATE statements
CREATE FOREIGN DATA WRAPPER
CREATE FOREIGN STREAM
CREATE FOREIGN TABLE
CREATE FUNCTION
CREATE JAR
CREATE LOCAL DATA WRAPPER
CREATE PROCEDURE
CREATE PUMP
CREATE SCHEMA
CREATE SERVER
CREATE STREAM
CREATE USER
CREATE VIEW
DELETE
DROP statements
DROP FOREIGN DATA WRAPPER
DROP FOREIGN STREAM
DROP FOREIGN TABLE
DROP FUNCTION
DROP JAR
DROP LOCAL DATA WRAPPER
DROP PROCEDURE
DROP PUMP
DROP SCHEMA
DROP SERVER
DROP STREAM
DROP VIEW
EXPLAIN PLAN
IMPORT FOREIGN SCHEMA
INSERT
MERGE
Query
SELECT statement
FROM clause
GROUP BY clause
HAVING clause
JOIN clause
OFFSET/FETCH Clause
ORDER BY clause
ROWTIME
SELECT ALL and SELECT DISTINCT
WHERE clause
WINDOW clause
SET statements
VALUES / VALUES CYCLE
Appendix A - List of Error Messages
Appendix B - SQL Limitations
Appendix C - Reserved Words and Key Words
Glossary
Adapter
Aggregate Function
ALTER
ANALYZE
Application Integration
Attribute
Calculator Error
Cartesian Join
Catalog
Checkpoint
Column
CREATE
Cross Join
Current Row
Cursor
Data Definition Language (DDL)
Data Manipulation Language (DML)
Data Wrapper
Datagen
Driver
DROP
Egress Column
EXCEPT
Extensible Common Data Adapter
Finite Relation
Foreign Data Wrapper
Foreign Server
Foreign Stream
Foreign Table
Function
Group Aggregate Function
High Watermark
Hopping Window
Inner Join
INSERT EXPEDITED
INTERSECT
Interval
Java Metadata Interface (JMI)
JDBC
JDBC Driver
Join
Join Condition
KeyWord
Late Rows
Local Data Wrapper
LOCALDB
Log File
Metadata
Metadata Repository (MDR)
Monotonically Increasing
Monotonicity
Native Stream
Natural Join
Node
Offset Window
Option
Outer Join
Partition
Path
Pipeline
Procedure
Project Schema
Projection
Provenance Column
Pump
Punctuation
Query Plan
Relation
Relational Operator
Repository
Repository Object
Repository Object
Routine
Row
Row-based Window
ROWTIME
Rowtime Bound
s-Dashboard
Sandboxed Mode
Schema
Schema Object
SELECT
Server
Server Properties
Session Variable
Shard
Sink
Sliding Window
Software Development Kit (SDK)
Source
SQL
SQL/MED
sqlline / sqllineClient
sqllineRemote
SQLstream s-Server
SQLstream s-Studio
Statistical Variance and Deviation Functions
Storage Engine
Stream
Stream Graph
Stream View
Streaming Aggregation
Streaming Data Protocol (SDP)
Streaming Query
Streaming Relation
StreamLab
Subquery
SYS_FTRS
SYS_JDBC
T-Sort
Table
Time-based Window
Timestamp
Tumbling Window
Tuple
UNION
UNION ALL
UPDATE
User
User Defined Function (UDF)
User Defined Procedure (UDP)
User Defined Routine (UDR)
User Defined Transform (UDX)
VALUES
View
WebAgent
Window
Window Aggregate Function
Windowed Aggregation
XML Metadata Interchange (XMI)
More
www.SQLstream.com
SQLstream product downloads
JDBC javadocs
JDBC-API.zip
SDK javadocs
SDK-API.zip
Last update: Wednesday, Nov 23, 2022
SQLstream Documentation
>
SQLstream Concepts
> Application Design Considerations
Application Design Considerations
The topics in this section are:
Queries That Run Forever
Pumps, Streams, and Processing Pipelines
Aggregation Windows
Advanced Stream Resequencing with SQLstream
Troubleshooting Processing Delays