JDBC Driver
Ignite is shipped with JDBC drivers that allow processing of distributed data using standard SQL statements like SELECT
, INSERT
, UPDATE
or DELETE
directly from the JDBC side.
Presently, there are two drivers supported by Ignite: the lightweight and easy to use JDBC Thin Driver described in this document and JDBC Client Driver that interacts with the cluster by means of a client node.
JDBC Thin Driver
The JDBC Thin driver is a default, lightweight driver provided by Ignite. To start using the driver, just add ignite-core-2.16.0.jar
to your application’s classpath.
The driver connects to one of the cluster nodes and forwards all the queries to it for final execution. The node handles the query distribution and the result’s aggregations. Then the result is sent back to the client application.
The JDBC connection string may be formatted with one of two patterns: URL query
or semicolon
:
// URL query pattern
jdbc:ignite:thin://<hostAndPortRange0>[,<hostAndPortRange1>]...[,<hostAndPortRangeN>][/schema][?<params>]
hostAndPortRange := host[:port_from[..port_to]]
params := param1=value1[¶m2=value2]...[¶mN=valueN]
// Semicolon pattern
jdbc:ignite:thin://<hostAndPortRange0>[,<hostAndPortRange1>]...[,<hostAndPortRangeN>][;schema=<schema_name>][;param1=value1]...[;paramN=valueN]
-
host
is required and defines the host of the cluster node to connect to. -
port_from
is the beginning of the port range to use to open the connection. 10800 is used by default if this parameter is omitted. -
port_to
is optional. It is set to theport_from
value by default if this parameter is omitted. -
schema
is the schema name to access. PUBLIC is used by default. This name should correspond to the SQL ANSI-99 standard. Non-quoted identifiers are not case sensitive. Quoted identifiers are case sensitive. When semicolon format is used, the schema may be defined as a parameter with name schema. -
<params>
are optional.
The name of the driver’s class is org.apache.ignite.IgniteJdbcThinDriver
. For instance, this is how you can open a JDBC connection to the cluster node listening on IP address 192.168.0.50:
// Register JDBC driver.
Class.forName("org.apache.ignite.IgniteJdbcThinDriver");
// Open the JDBC connection.
Connection conn = DriverManager.getConnection("jdbc:ignite:thin://127.0.0.1");
Note
|
Put the JDBC URL in quotes when connecting from bashMake sure to put the connection URL in double quotes (" ") when connecting from a bash environment, for example: |
Parameters
The following table lists all the parameters that are supported by the JDBC connection string:
Parameter | Description | Default Value |
---|---|---|
|
Username for the SQL Connection. This parameter is required if authentication is enabled on the server. See the Authentication and CREATE user documentation for more details. |
ignite |
|
Password for SQL Connection. Required if authentication is enabled on the server. See the Authentication and CREATE user documentation for more details. |
|
|
Whether to execute distributed joins in non-colocated mode. |
false |
|
Whether to enforce join order of tables in the query. If set to |
|
|
Set this parameter to |
|
|
Whether to close server-side cursors automatically when the last piece of a result set is retrieved. When this property is enabled, calling |
|
|
Enables Partition Awareness mode. In this mode, the driver tries to determine the nodes where the data that is being queried is located and send the query to these nodes. |
|
The number of distinct SQL queries that the driver keeps locally for optimization. When a query is executed for the first time, the driver receives the partition distribution for the table that is being queried and saves it for future use locally. When you query this table next time, the driver uses the partition distribution to determine where the data being queried is located to send the query to the right nodes. This local storage with SQL queries invalidates when the cluster topology changes. The optimal value for this parameter should equal the number of distinct SQL queries you are going to perform. |
1000 |
|
The number of distinct objects that represent partition distribution that the driver keeps locally for optimization. See the description of the previous parameter for details. This local storage with partition distribution objects invalidates when the cluster topology changes. The optimal value for this parameter should equal the number of distinct tables (cache groups) you are going to use in your queries. |
1000 |
|
|
Socket send buffer size. When set to 0, the OS default is used. |
0 |
|
Socket receive buffer size. When set to 0, the OS default is used. |
0 |
|
Whether to use |
|
|
Enables server side updates.
When Ignite executes a DML operation, it fetches all the affected intermediate rows and sends them to the query initiator (also known as reducer) for analysis. Then it prepares batches of updated values to be sent to remote nodes.
This approach might impact performance and it can saturate the network if a DML operation has to move many entries over it.
Use this flag to tell Ignite to perform all intermediate row analysis and updates "in-place" on corresponding remote data nodes.
Defaults to |
|
|
Sets the number of seconds the driver will wait for a Statement object to execute. Zero means there is no limits. |
|
|
Sets the number of milliseconds JDBC client will waits for server to response. Zero means there is no limits. |
'0' |
For the list of security parameters, refer to the Using SSL section.
Connection String Examples
-
jdbc:ignite:thin://myHost
- connect to myHost on the port 10800 with all defaults. -
jdbc:ignite:thin://myHost:11900
- connect to myHost on custom port 11900 with all defaults. -
jdbc:ignite:thin://myHost:11900;user=ignite;password=ignite
- connect to myHost on custom port 11900 with user credentials for authentication. -
jdbc:ignite:thin://myHost:11900;distributedJoins=true&autoCloseServerCursor=true
- connect to myHost on custom port 11900 with enabled distributed joins and autoCloseServerCursor optimization. -
jdbc:ignite:thin://myHost:11900/myschema;
- connect to myHost on custom port 11900 and access to MYSCHEMA. -
jdbc:ignite:thin://myHost:11900/"MySchema";lazy=false
- connect to myHost on custom port 11900 with disabled lazy query execution and access to MySchema (schema name is case sensitive).
Multiple Endpoints
You can enable automatic failover if a current connection is broken by setting multiple connection endpoints in the connection string. The JDBC Driver randomly picks an address from the list to connect to. If the connection fails, the JDBC Driver selects another address from the list until the connection is restored. The Driver stops reconnecting and throws an exception if all the endpoints are unreachable.
The example below shows how to pass three addresses via the connection string:
// Register JDBC Driver.
Class.forName("org.apache.ignite.IgniteJdbcThinDriver");
// Open the JDBC connection passing several connection endpoints.
Connection conn = DriverManager
.getConnection("jdbc:ignite:thin://192.168.0.50:101,192.188.5.40:101,192.168.10.230:101");
Partition Awareness
Warning
|
Partition awareness is an experimental feature whose API or design architecture might be changed before a GA version is released. |
Partition awareness is a feature that makes the JDBC driver "aware" of the partition distribution in the cluster. It allows the driver to pick the nodes that own the data that is being queried and send the query directly to those nodes (if the addresses of the nodes are provided in the driver’s configuration). Partition awareness can increase average performance of queries that use the affinity key.
Without partition awareness, the JDBC driver connects to a single node, and all queries are executed through that node. If the data is hosted on a different node, the query has to be rerouted within the cluster, which adds an additional network hop. Partition awareness eliminates that hop by sending the query to the right node.
To make use of the partition awareness feature, provide the addresses of all the server nodes in the connection properties. The driver will route requests to the nodes that store the data requested by the query.
Warning
|
Note that presently you need to provide the addresses of all server nodes in the connection properties because the driver does not load them automatically after a connection is opened. It also means that if a new server node joins the cluster, you are advised to reconnect the driver and add the node’s address to the connection properties. Otherwise, the driver will not be able to send direct requests to this node. |
To enable partition awareness, add the partitionAwareness=true
parameter to the connection string and provide the
endpoints of multiple server nodes:
Class.forName("org.apache.ignite.IgniteJdbcThinDriver");
Connection conn = DriverManager
.getConnection("jdbc:ignite:thin://192.168.0.50,192.188.5.40,192.168.10.230?partitionAwareness=true");
Note
|
Partition Awareness can be used only with the default affinity function. |
Also see the description of the two related parameters: partitionAwarenessSQLCacheSize and partitionAwarenessPartitionDistributionsCacheSize.
Cluster Configuration
In order to accept and process requests from JDBC Thin Driver, a cluster node binds to a local network interface on port 10800 and listens to incoming requests.
Use an instance of ClientConnectorConfiguration
to change the connection parameters:
<bean id="ignite.cfg" class="org.apache.ignite.configuration.IgniteConfiguration">
<property name="clientConnectorConfiguration">
<bean class="org.apache.ignite.configuration.ClientConnectorConfiguration" />
</property>
</bean>
IgniteConfiguration cfg = new IgniteConfiguration()
.setClientConnectorConfiguration(new ClientConnectorConfiguration());
The following parameters are supported:
Parameter | Description | Default Value |
---|---|---|
|
Host name or IP address to bind to. When set to |
|
|
TCP port to bind to. If the specified port is already in use, Ignite tries to find another available port using the |
|
|
Defines the number of ports to try to bind to. E.g. if the port is set to |
|
|
Maximum number of cursors that can be opened simultaneously for a single connection. |
|
|
Number of request-handling threads in the thread pool. |
|
|
Size of the TCP socket send buffer. When set to 0, the system default value is used. |
|
|
Size of the TCP socket receive buffer. When set to 0, the system default value is used. |
|
|
Whether to use |
|
|
Idle timeout for client connections. Clients are disconnected automatically from the server after remaining idle for the configured timeout. When this parameter is set to zero or a negative value, the idle timeout is disabled. |
|
|
Whether access through JDBC is enabled. |
|
|
Whether access through thin client is enabled. |
|
|
If SSL is enabled, only SSL client connections are allowed. The node allows only one mode of connection: |
|
|
Whether to use SSL context factory from the node’s configuration (see |
|
|
Whether client authentication is required. |
|
|
The class name that implements |
|
Warning
|
JDBC Thin Driver is not thread safeThe JDBC objects JDBC Thin Driver guards against concurrency. If concurrent access is detected, an exception
( "Concurrent access to JDBC connection is not allowed [ownThread=<guard_owner_thread_name>, curThread=<current_thread_name>]", SQLSTATE="08006" |
Using SSL
You can configure the JDBC Thin Driver to use SSL to secure communication with the cluster. SSL must be configured both on the cluster side and in the JDBC Driver. Refer to the SSL for Thin Clients and JDBC/ODBC section for the information about cluster configuration.
To enable SSL in the JDBC Driver, pass the sslMode=require
parameter in the connection string and provide the key store and trust store parameters:
Class.forName("org.apache.ignite.IgniteJdbcThinDriver");
String keyStore = "keystore/node.jks";
String keyStorePassword = "123456";
String trustStore = "keystore/trust.jks";
String trustStorePassword = "123456";
try (Connection conn = DriverManager.getConnection("jdbc:ignite:thin://127.0.0.1?sslMode=require"
+ "&sslClientCertificateKeyStoreUrl=" + keyStore + "&sslClientCertificateKeyStorePassword="
+ keyStorePassword + "&sslTrustCertificateKeyStoreUrl=" + trustStore
+ "&sslTrustCertificateKeyStorePassword=" + trustStorePassword)) {
ResultSet rs = conn.createStatement().executeQuery("select 10");
rs.next();
System.out.println(rs.getInt(1));
} catch (Exception e) {
e.printStackTrace();
}
The following table lists all parameters that affect SSL/TLS connection:
Parameter |
Description |
Default Value |
||
|
Enables SSL connection. Available modes:
|
|
||
|
Protocol name for secure transport. Protocol implementations supplied by JSSE: |
|
||
|
The Key manager algorithm to be used to create a key manager. Note that in most cases the default value is sufficient.
Algorithms implementations supplied by JSSE: |
|
||
|
URL of the client key store file.
This is a mandatory parameter since SSL context cannot be initialized without a key manager.
If |
The value of the
|
||
|
Client key store password. If |
The value of the |
||
|
Client key store type used in context initialization. If |
The value of the
|
||
|
URL of the trust store file. This is an optional parameter; however, one of these properties must be set: If |
The value of the
|
||
|
Trust store password. If |
The value of the
|
||
|
Trust store type. If |
The value of the
|
||
|
Disables server’s certificate validation. Set to
|
|
||
|
Class name of the custom implementation of the
If |
|
The default implementation is based on JSSE, and works through two Java keystore files:
-
sslClientCertificateKeyStoreUrl
- the client certificate keystore holds the keys and certificate for the client. -
sslTrustCertificateKeyStoreUrl
- the trusted certificate keystore contains the certificate information to validate the server’s certificate.
The trusted store is an optional parameter, however one of the following parameters: sslTrustCertificateKeyStoreUrl
or sslTrustAll
must be configured.
Warning
|
Using the "sslTrustAll" optionDo not enable this option in production on a network you do not entirely trust, especially anything using the public internet. |
If you want to use your own implementation or method to configure the SSLSocketFactory
, you can use JDBC Driver’s sslFactory
parameter. It is a string that must contain the name of the class that implements the interface Factory<SSLSocketFactory>
. The class must be available for JDBC Driver’s class loader.
Ignite DataSource
The DataSource object is used as a deployed object that can be located by logical name via the JNDI naming service. JDBC Driver’s org.apache.ignite.IgniteJdbcThinDataSource
implements a JDBC DataSource interface allowing you to utilize the DataSource interface instead.
In addition to generic DataSource properties, IgniteJdbcThinDataSource
supports all the Ignite-specific properties that can be passed into a JDBC connection string. For instance, the distributedJoins
property can be (re)set via the IgniteJdbcThinDataSource#setDistributedJoins()
method.
Refer to the JavaDocs for more details.
Examples
To start processing the data located in the cluster, you need to create a JDBC Connection object via one of the methods below:
// Open the JDBC connection via DriverManager.
Connection conn = DriverManager.getConnection("jdbc:ignite:thin://192.168.0.50");
or
// Or open connection via DataSource.
IgniteJdbcThinDataSource ids = new IgniteJdbcThinDataSource();
ids.setUrl("jdbc:ignite:thin://127.0.0.1");
ids.setDistributedJoins(true);
Connection conn = ids.getConnection();
Then you can execute SQL SELECT queries as follows:
// Query people with specific age using prepared statement.
PreparedStatement stmt = conn.prepareStatement("select name, age from Person where age = ?");
stmt.setInt(1, 30);
ResultSet rs = stmt.executeQuery();
while (rs.next()) {
String name = rs.getString("name");
int age = rs.getInt("age");
// ...
}
You can also modify the data via DML statements.
INSERT
// Insert a Person with a Long key.
PreparedStatement stmt = conn
.prepareStatement("INSERT INTO Person(_key, name, age) VALUES(CAST(? as BIGINT), ?, ?)");
stmt.setInt(1, 1);
stmt.setString(2, "John Smith");
stmt.setInt(3, 25);
stmt.execute();
MERGE
// Merge a Person with a Long key.
PreparedStatement stmt = conn
.prepareStatement("MERGE INTO Person(_key, name, age) VALUES(CAST(? as BIGINT), ?, ?)");
stmt.setInt(1, 1);
stmt.setString(2, "John Smith");
stmt.setInt(3, 25);
stmt.executeUpdate();
UPDATE
// Update a Person.
conn.createStatement().
executeUpdate("UPDATE Person SET age = age + 1 WHERE age = 25");
DELETE
conn.createStatement().execute("DELETE FROM Person WHERE age = 25");
Streaming
JDBC Driver allows streaming data in bulk using the SET
command. See the SET
command documentation for more information.
Error Codes
The JDBC drivers pass error codes in the java.sql.SQLException
class, used to facilitate exception handling on the application side. To get an error code, use the java.sql.SQLException.getSQLState()
method. It returns a string containing the ANSI SQLSTATE error code defined:
PreparedStatement ps;
try {
ps = conn.prepareStatement("INSERT INTO Person(id, name, age) values (1, 'John', 'unparseableString')");
} catch (SQLException e) {
switch (e.getSQLState()) {
case "0700B":
System.out.println("Conversion failure");
break;
case "42000":
System.out.println("Parsing error");
break;
default:
System.out.println("Unprocessed error: " + e.getSQLState());
break;
}
}
The table below lists all the ANSI SQLSTATE error codes currently supported by Ignite. Note that the list may be extended in the future.
Code | Description |
---|---|
0700B |
Conversion failure (for example, a string expression cannot be parsed as a number or a date). |
0700E |
Invalid transaction isolation level. |
08001 |
The driver failed to open a connection to the cluster. |
08003 |
The connection is in the closed state. Happened unexpectedly. |
08004 |
The connection was rejected by the cluster. |
08006 |
I/O error during communication. |
22004 |
Null value not allowed. |
22023 |
Unsupported parameter type. |
23000 |
Data integrity constraint violation. |
24000 |
Invalid result set state. |
0A000 |
Requested operation is not supported. |
40001 |
Concurrent update conflict. See Concurrent Updates. |
42000 |
Query parsing exception. |
50000 |
Internal error.
The code is not defined by ANSI and refers to an Ignite specific error. Refer to the |
Apache, Apache Ignite, the Apache feather and the Apache Ignite logo are either registered trademarks or trademarks of The Apache Software Foundation.