SQLite Changelog

What's new in SQLite 3.45.2

Mar 13, 2024
  • Fix an error in UPSERT, introduced by enhancement 3a in version 3.35.0 (2021-03-12), that could cause an index to get out-of-sync with its table.
  • Reduce the scope of the NOT NULL strength reduction optimization that was added as item 8e in version 3.35.0 (2021-03-12). The optimization was being attempted in some contexts where it did not work, resulting in incorrect query results.
  • Other trifling corrections and compiler warning fixes that have come up since the previous patch release.

New in SQLite 3.45.1 (Jan 30, 2024)

  • Restore the JSON BLOB input bug, and promise to support the anomaly in subsequent releases, for backward compatibility.
  • Fix the PRAGMA integrity_check command so that it works on read-only databases that contain FTS3 and FTS5 tables. This resolves an issue introduced in version 3.44.0 but was undiscovered until after the 3.45.0 release.
  • Fix a long-standing bug in which a read of a few bytes past the end of a memory-mapped segment might occur when accessing a craftily corrupted database using memory-mapped database.
  • Fix a long-standing bug in which a NULL pointer dereference might occur in the bytecode engine due to incorrect bytecode being generated for a class of SQL statements that are deliberately designed to stress the query planner but which are otherwise pointless.
  • Fix issues associated with processing corrupt JSONB inputs:
  • Prevent exponential runtime when converting a corrupt JSONB into text.
  • Fix a possible read of one byte past the end of the JSONB blob when converting a corrupt JSONB into text.
  • Enhanced testing using jfuzz to prevent any future JSONB problems such as the above.

New in SQLite 3.45.0 (Jan 16, 2024)

  • Added the SQLITE_RESULT_SUBTYPE property for application-defined SQL functions. All application defined SQL functions that invokes sqlite3_result_subtype() must be registered with this new property. Failure to do so might cause the call to sqlite3_result_subtype() to behave as a no-op. Compile with -DSQLITE_STRICT_SUBTYPE=1 to cause an SQL error to be raised if a function that is not SQLITE_RESULT_SUBTYPE tries invokes sqlite3_result_subtype(). The use of -DSQLITE_STRICT_SUBTYPE=1 is a recommended compile-time option for every application that makes use of subtypes.
  • Add the FTS5 tokendata option to the FTS5 virtual table.
  • The SQLITE_DIRECT_OVERFLOW_READ optimization is now enabled by default. Disable it at compile-time using -DSQLITE_DIRECT_OVERFLOW_READ=0.
  • Increase the default value for SQLITE_MAX_PAGE_COUNT from 1073741824 to 4294967294.
  • Enhancements to the JSON SQL functions:
  • All JSON functions are rewritten to use a new internal parse tree format called JSONB. The new parse-tree format is serializable and hence can be stored in the database to avoid unnecessary re-parsing whenever the JSON value is used.
  • New versions of JSON-generating functions generate binary JSONB instead of JSON text.
  • The json_valid() function adds an optional second argument that specifies what it means for the first argument to be "well-formed".
  • Query planner improvements:
  • Do not allow the transitive constraint optimization to trick the query planner into using a range constraint when a better equality constraint is available. (Forum post 2568d1f6e6.)
  • The query planner now does a better job of disregarding indexes that ANALYZE identifies as low-quality. (Forum post 6f0958b03b.)
  • Enhancements to the CLI:
  • Improvements to the display of UTF-8 content on Windows
  • Automatically detect playback of ".dump" scripts and make appropriate changes to settings such as ".dbconfig defensive off" and ".dbconfig dqs_dll on".

New in SQLite 3.44.2 (Nov 27, 2023)

  • Fix a mistake in the CLI that was introduced by the fix (item 15 above) in 3.44.1.
  • Fix a problem in FTS5 that was discovered during internal fuzz testing only minutes after the 3.44.1 release was tagged.
  • Fix incomplete assert() statements that the fuzzer discovered the day after the previous release.
  • Fix a couple of harmless compiler warnings that appeared in debug builds with GCC 16.

New in SQLite 3.44.1 (Nov 27, 2023)

  • Change the CLI so that it uses UTF-16 for console I/O on Windows. This enables proper display of unicode text on old Windows7 machines.
  • Other obscure bug fixes.

New in SQLite 3.44.0 (Nov 1, 2023)

  • Aggregate functions can now include an ORDER BY clause after their last parameter. The arguments to the function are processed in the order specified. This can be important for functions like string_agg() and json_group_array().
  • Add support for the concat() and concat_ws() scalar SQL functions, compatible with PostgreSQL, SQLServer, and MySQL.
  • Add support for the string_agg() aggregate SQL function, compatible with PostgreSQL and SQLServer.
  • New conversion letters on the strftime() SQL function: %e %F %I %k %l %p %P %R %T %u
  • Add new C-language APIs: sqlite3_get_clientdata() and sqlite3_set_clientdata().
  • Many errors associated with CREATE TABLE are now raised when the CREATE TABLE statement itself is run, rather than being deferred until the first time the table is actually used.
  • The PRAGMA integrity_check command now verifies the consistency of the content in various built-in virtual tables using the new xIntegrity method. This works for the FTS3, FTS4, FTS5, RTREE, and GEOPOLY extensions.
  • The SQLITE_DBCONFIG_DEFENSIVE setting now prevents PRAGMA writable_schema from being turned on. Previously writable_schema could be turned on, but would not actually allow the schema to be writable. Now it simply cannot be turned on.
  • Tag the built-in FTS3, FTS4, FTS5, RTREE, and GEOPOLY virtual tables as SQLITE_VTAB_INNOCUOUS so that they can be used inside of triggers in high-security deployments.
  • The PRAGMA case_sensitive_like statement is deprecated, as its use when the schema contains LIKE operators can lead to reports of database corruption by PRAGMA integrity_check.
  • SQLITE_USE_SEH (Structured Exception Handling) is now enabled by default whenever SQLite is built using the Microsoft C compiler. It can be disabled using -DSQLITE_USE_SEH=0
  • SQLite now performs run-time detection of whether or not the underlying hardware supports "long double" with precision greater than "double" and uses appropriate floating-point routines depending on what it discovered.
  • The CLI for Windows now defaults to using UTF-8 for both input and output on platforms that support it. The --no-utf8 option is available to disable UTF8 support.
  • Query planner optimizations:
  • In partial index scans, if the WHERE clause implies a constant value for a table column, replace occurrences of that table column with the constant. This increases the likelihood of the partial index being a covering index.
  • Disable the view-scan optimization (added in version 3.42.0 - item 1c) as it was causing multiple performance regressions. In its place, reduce the estimated row count for DISTINCT subqueries by a factor of 8.

New in SQLite 3.43.2 (Oct 11, 2023)

  • Fix a couple of obscure UAF errors and an obscure memory leak.
  • Omit the use of the sprintf() function from the standard library in the CLI, as this now generates warnings on some platforms.
  • Avoid conversion of a double into unsigned long long integer, as some platforms do not do such conversions correctly.

New in SQLite 3.43.1 (Sep 11, 2023)

  • Fix a regression in the way that the sum(), avg(), and total() aggregate functions handle infinities.
  • Fix a bug in the json_array_length() function that occurs when the argument comes directly from json_remove().
  • Fix the omit-unused-subquery-columns optimization (introduced in in version 3.42.0) so that it works correctly if the subquery is a compound where one arm is DISTINCT and the other is not.
  • Other minor fixes.

New in SQLite 3.43.0 (Aug 25, 2023)

  • Add support for Contentless-Delete FTS5 Indexes. This is a variety of FTS5 full-text search index that omits storing the content that is being indexed while also allowing records to be deleted.
  • Enhancements to the date and time functions:
  • Added new time shift modifiers of the form ±YYYY-MM-DD HH:MM:SS.SSS.
  • Added the timediff() SQL function.
  • Added the octet_length(X) SQL function.
  • Added the sqlite3_stmt_explain() API.
  • Query planner enhancements:
  • Generalize the LEFT JOIN strength reduction optimization so that it works for RIGHT and FULL JOINs as well. Rename it to OUTER JOIN strength reduction.
  • Enhance the theorem prover in the OUTER JOIN strength reduction optimization so that it returns fewer false-negatives.
  • Enhancements to the decimal extension:
  • New function decimal_pow2(N) returns the N-th power of 2 for integer N between -20000 and +20000.
  • New function decimal_exp(X) works like decimal(X) except that it returns the result in exponential notation - with a "e+NN" at the end.
  • If X is a floating-point value, then the decimal(X) function now does a full expansion of that value into its exact decimal equivalent.
  • Performance enhancements to JSON processing results in a 2x performance improvement for some kinds of processing on large JSON strings.
  • New makefile target "verify-source" checks to ensure that there are no unintentional changes in the source tree. (Works for canonical source code only - not for precompiled amalgamation tarballs.)
  • Added the SQLITE_USE_SEH compile-time option that enables Structured Exception Handling on Windows while working with the memory-mapped shm file that is part of WAL mode processing. This option is enabled by default when building on Windows using Makefile.msc.
  • The VFS for unix now assumes that the nanosleep() system call is available unless compiled with -DHAVE_NANOSLEEP=0.

New in SQLite 3.42.0 (May 17, 2023)

  • Add the FTS5 secure-delete command. This option causes all forensic traces to be removed from the FTS5 inverted index when content is deleted.
  • Enhance the JSON SQL functions to support JSON5 extensions.
  • The SQLITE_CONFIG_LOG and SQLITE_CONFIG_PCACHE_HDRSZ calls to sqlite3_config() are now allowed to occur after sqlite3_initialize().
  • New sqlite3_db_config() options: SQLITE_DBCONFIG_STMT_SCANSTATUS and SQLITE_DBCONFIG_REVERSE_SCANORDER.
  • Query planner improvements.
  • Enable the "count-of-view" optimization by default.
  • Avoid computing unused columns in subqueries.
  • Improvements to the push-down optimization.
  • Enhancements to the CLI.
  • Add the --unsafe-testing command-line option. Without this option, some dot-commands (ex: ".testctrl") are now disabled because those commands that are intended for testing only and can cause malfunctions misused.
  • Allow commands ".log on" and ".log off", even in --safe mode.
  • "--" as a command-line argument means all subsequent arguments that start with "-" are interpreted as normal non-option argument.
  • Magic parameters ":inf" and ":nan" bind to floating point literals Infinity and NaN, respectively.
  • The --utf8 command-line option omits all translation to or from MBCS on the Windows console for interactive sessions, and sets the console code page for UTF-8 I/O during such sessions. The --utf8 option is a no-op on all other platforms.
  • Add the ability for application-defined SQL functions to have the same name as join keywords: CROSS, FULL, INNER, LEFT, NATURAL, OUTER, or RIGHT.
  • Enhancements to PRAGMA integrity_check.
  • Detect and raise an error when a NaN value is stored in a NOT NULL column.
  • Improved error message output identifies the root page of a b-tree when an error is found within a b-tree.
  • Allow the session extension to be configured to capture changes from tables that lack an explicit ROWID.
  • Added the subsecond modifier to the date and time functions.
  • Negative values passed into sqlite3_sleep() are henceforth interpreted as 0.
  • The maximum recursion depth for JSON arrays and objects is lowered from 2000 to 1000.
  • Extended the built-in printf() function so the comma option now works with floating-point conversions in addition to integer conversions.
  • Miscellaneous bug fixes and performance optimizations

New in SQLite 3.41.2 (Mar 22, 2023)

  • Fix the sqlite3_error_offset() so that it does not return out-of-range values when reporting errors associated with generated columns.
  • Multiple fixes in the query optimizer for problems that cause incorrect results for bizarre, fuzzer-generated queries.
  • Increase the size of the reference counter in the page cache object to 64 bits to ensure that the counter never overflows.
  • Fix a performance regression caused by a bug fix in patch release 3.41.1.
  • Fix a few incorrect assert() statements.
  • Multiple fixes for reads past the end of memory buffers (NB: reads not writes) in the following circumstances:
  • When processing a corrupt database file using the non-standard SQLITE_ENABLE_STAT4 compile-time option.
  • In the CLI when the sqlite3_error_offset() routine returns an out-of-range value (see also the fix to sqlite3_error_offset() below).
  • In the recovery extension.
  • In FTS3 when processing a corrupt database file.

New in SQLite 3.41.1 (Mar 10, 2023)

  • Provide compile-time options -DHAVE_LOG2=0 and -DHAVE_LOG10=0 to enable SQLite to be compiled on systems that omit the standard library functions log2() and log10(), repectively.
  • Ensure that the datatype for column t1.x in "CREATE TABLE t1 AS SELECT CAST(7 AS INT) AS x;" continues to be INT and is not NUM, for historical compatibility.
  • Enhance PRAGMA integrity_check to detect when extra bytes appear at the end of an index record.
  • Fix various obscure bugs reported by the user community. See the timeline of changes for details.

New in SQLite 3.41.0 (Feb 22, 2023)

  • Query planner improvements:
  • Make use of indexed expressions within an aggregate query that includes a GROUP BY clause.
  • The query planner has improved awareness of when an index is a covering index and adjusts predicted runtimes accordingly.
  • The query planner is more aggressive about using co-routines rather than materializing subqueries and views.
  • Queries against the built-in table-valued functions json_tree() and json_each() will now usually treat "ORDER BY rowid" as a no-op.
  • Enhance the ability of the query planner to use indexed expressions even if the expression has been modified by the constant-propagation optimization. (See forum thread 0a539c7.)
  • Add the built-in unhex() SQL function.
  • Add the base64 and base85 application-defined functions as an extension and include that extension in the CLI.
  • Add the sqlite3_stmt_scanstatus_v2() interface. (This interface is only available if SQLite is compiled using SQLITE_ENABLE_STMT_SCANSTATUS.)
  • In-memory databases created using sqlite3_deserialize() now report their filename as an empty string, not as 'x'.
  • Changes to the CLI:
  • Add the new base64() and base85() SQL functions
  • Enhanced EXPLAIN QUERY PLAN output using the new sqlite3_stmt_scanstatus_v2() interface when compiled using SQLITE_ENABLE_STMT_SCANSTATUS.
  • The ".scanstats est" command provides query planner estimates in profiles.
  • The continuation prompt indicates if the input is currently inside of a string literal, identifier literal, comment, trigger definition, etc.
  • Enhance the --safe command-line option to disallow dangerous SQL functions.
  • The double-quoted string misfeature is now disabled by default for CLI builds. Legacy use cases can reenable the misfeature at run-time using the ".dbconfig dqs_dml on" and ".dbconfig dqs_ddl on" commands.
  • Enhance the PRAGMA integrity_check command so that it detects when text strings in a table are equivalent to but not byte-for-byte identical to the same strings in the index.
  • Enhance the carray table-valued function so that it is able to bind an array of BLOB objects.
  • Added the sqlite3_is_interrupted() interface.
  • Long-running calls to sqlite3_prepare() and similar now invoke the progress handler callback and react to sqlite3_interrupt().
  • The sqlite3_vtab_in_first() and sqlite3_vtab_in_next() functions are enhanced so that they reliably detect if they are invoked on a parameter that was not selected for multi-value IN processing using sqlite3_vtab_in(). They return SQLITE_ERROR instead of SQLITE_MISUSE in this case.
  • The parser now ignores excess parentheses around a subquery on the right-hand side of an IN operator, so that SQLite now works the same as PostgreSQL in this regard. Formerly, SQLite treated the subquery as an expression with an implied "LIMIT 1".
  • Added the SQLITE_FCNTL_RESET_CACHE option to the sqlite3_file_control() API.
  • Makefile improvements:
  • The new makefile target "sqlite3r.c" builds an amalgamation that includes the recovery extension.
  • New makefile targets "devtest" and "releasetest" for running a quick developmental test prior to doing a check-in and for doing a full release test, respectively.
  • Miscellaneous performance enhancements.

New in SQLite 3.40.1 (Dec 28, 2022)

  • Fix the --safe command-line option to the CLI such that it correctly disallows the use of SQL functions like writefile() that can cause harmful side-effects.
  • Fix a potential infinite loop in the memsys5 alternative memory allocator. This bug was introduced by a performance optimization in version 3.39.0.
  • Various other obscure fixes.

New in SQLite 3.40.0 (Nov 16, 2022)

  • Add support for compiling SQLite to WASM and running it in web browsers. NB: The WASM build and its interfaces are considered "beta" and are subject to minor changes if the need arises. We anticipate finalizing the interface for the next release.
  • Add the recovery extension that might be able to recover some content from a corrupt database file.
  • Query planner enhancements
  • Recognize covering indexes on tables with more than 63 columns where columns beyond the 63rd column are used in the query and/or are referenced by the index.
  • Extract the values of expressions contained within expression indexes where practical, rather than recomputing the expression.
  • The NOT NULL and IS NULL operators (and their equivalents) avoid loading the content of large strings and BLOB values from disk.
  • Avoid materializing a view on which a full scan is performed exactly once. Use and discard the rows of the view as they are computed.
  • Allow flattening of a subquery that is the right-hand operand of a LEFT JOIN in an aggregate query.
  • A new typedef named sqlite3_filename is added and used to represent the name of a database file. Various interfaces are modified to use the new typedef instead of "char*". This interface change should be fully backwards compatible, though it might cause (harmless) compiler warnings when rebuilding some legacy applications.
  • Add the sqlite3_value_encoding() interface.
  • Security enhancement: SQLITE_DBCONFIG_DEFENSIVE is augmented to prohibit changing the schema_version. The schema_version becomes read-only in defensive mode.
  • Enhancements to the PRAGMA integrity_check statement
  • Columns in non-STRICT tables with TEXT affinity should not contain numeric values.
  • Columns in non-STRICT tables with NUMERIC affinity should not contain TEXT values that could be converted into numbers.
  • Verify that the rows of a WITHOUT ROWID table are in the correct order.
  • Enhance the VACUUM INTO statement so that it honors they PRAGMA synchronous setting.
  • Enhance the sqlite3_strglob() and sqlite3_strlike() APIs so that they are able to accept NULL pointers for their string parameters and still generate a sensible result.
  • Provide the new SQLITE_MAX_ALLOCATION_SIZE compile-time option for limiting the size of memory allocations.
  • Change the algorithm used by SQLite's built-in pseudo-random number generator (PRNG) from RC4 to Chacha20.
  • Allow two or more indexes to have the same name as long as they are all in separate schemas.
  • Miscellaneous performance optimizations result in about 1% fewer CPU cycles used on typical workloads.

New in SQLite 3.39.4 (Sep 30, 2022)

  • Fix the build on Windows so that it works with -DSQLITE_OMIT_AUTOINIT
  • Fix a long-standing problem in the btree balancer that might, in rare cases, cause database corruption if the application uses an application-defined page cache.
  • Enhance SQLITE_DBCONFIG_DEFENSIVE so that it disallows CREATE TRIGGER statements if one or more of the statements in the body of the trigger write into shadow tables.
  • Fix a possible integer overflow in the size computation for a memory allocation in FTS3.
  • Fix a misuse of the sqlite3_set_auxdata() interface in the ICU Extension.

New in SQLite 3.39.3 (Sep 30, 2022)

  • Use a statement journal on DML statement affecting two or more database rows if the statement makes use of a SQL functions that might abort. See forum thread 9b9e4716c0d7bbd1.
  • Use a mutex to protect the PRAGMA temp_store_directory and PRAGMA data_store_directory statements, even though they are deprecated and documented as not being threadsafe. See forum post 719a11e1314d1c70.
  • Other bug and warning fixes. See the timeline for details.

New in SQLite 3.39.2 (Jul 22, 2022)

  • Fix a performance regression in the query planner associated with rearranging the order of FROM clause terms in the presences of a LEFT JOIN.
  • Apply fixes for CVE-2022-35737, Chromium bugs 1343348 and 1345947, forum post 3607259d3c, and other minor problems discovered by internal testing.

New in SQLite 3.39.1 (Jul 14, 2022)

  • Fix an incorrect result from a query that uses a view that contains a compound SELECT in which only one arm contains a RIGHT JOIN and where the view is not the first FROM clause term of the query that contains the view. forum post 174afeae5734d42d.
  • Fix some harmless compiler warnings.
  • Fix a long-standing problem with ALTER TABLE RENAME that can only arise if the sqlite3_limit(SQLITE_LIMIT_SQL_LENGTH) is set to a very small value.
  • Fix a long-standing problem in FTS3 that can only arise when compiled with the SQLITE_ENABLE_FTS3_PARENTHESIS compile-time option.
  • Fix the build so that is works when the SQLITE_DEBUG and SQLITE_OMIT_WINDOWFUNC compile-time options are both provided at the same time.
  • Fix the initial-prefix optimization for the REGEXP extension so that it works correctly even if the prefix contains characters that require a 3-byte UTF8 encoding.
  • Enhance the sqlite_stmt virtual table so that it buffers all of its output.

New in SQLite 3.39.0 (Jun 26, 2022)

  • Add (long overdue) support for RIGHT and FULL OUTER JOIN.
  • Add new binary comparison operators IS NOT DISTINCT FROM and IS DISTINCT FROM that are equivalent to IS and IS NOT, respective, for compatibility with PostgreSQL and SQL standards.
  • Add a new return code (value "3") from the sqlite3_vtab_distinct() interface that indicates a query that has both DISTINCT and ORDER BY clauses.
  • Added the sqlite3_db_name() interface.
  • The unix os interface resolves all symbolic links in database filenames to create a canonical name for the database before the file is opened.
  • Defer materializing views until the materialization is actually needed, thus avoiding unnecessary work if the materialization turns out to never be used.
  • The HAVING clause of a SELECT statement is now allowed on any aggregate query, even queries that do not have a GROUP BY clause.
  • Many microoptimizations collectively reduce CPU cycles by about 2.3%.

New in SQLite 3.38.5 (May 8, 2022)

  • Fix a blunder in the CLI of the 3.38.4 release.

New in SQLite 3.38.4 (May 5, 2022)

  • Fix a byte-code problem in the Bloom filter pull-down optimization added by release 3.38.0 in which an error in the byte code causes the byte code engine to enter an infinite loop when the pull-down optimization encounters a NULL key. Forum thread 2482b32700384a0f.
  • Other minor patches. See the timeline for details.

New in SQLite 3.38.3 (Apr 28, 2022)

  • Fix a case of the query planner be overly aggressive with optimizing automatic-index and Bloom-filter construction, using inappropriate ON clause terms to restrict the size of the automatic-index or Bloom filter, and resulting in missing rows in the output. Forum thread 0d3200f4f3bcd3a3.
  • Other minor patches. See the timeline for details.

New in SQLite 3.38.2 (Apr 28, 2022)

  • Fix a user-discovered problem with the new Bloom filter optimization that might cause an incorrect answer when doing a LEFT JOIN with a WHERE clause constraint that says that one of the columns on the right table of the LEFT JOIN is NULL. See forum thread 031e262a89b6a9d2.
  • Other minor patches. See the timeline for details.

New in SQLite 3.38.1 (Mar 15, 2022)

  • Fix problems with the new Bloom filter optimization that might cause some obscure queries to get an incorrect answer.
  • Fix the localtime modifier of the date and time functions so that it preserves fractional seconds.
  • Fix the sqlite_offset SQL function so that it works correctly even in corner cases such as when the argument is a virtual column or the column of a view.
  • Fix row value IN operator constraints on virtual tables so that they work correctly even if the virtual table implementation relies on bytecode to filter rows that do not satisfy the constraint.
  • Other minor fixes to assert() statements, test cases, and documentation. See the source code timeline for details.

New in SQLite 3.38.0 (Feb 23, 2022)

  • Added the -> and ->> operators for easier processing of JSON. The new operators are compatible with MySQL and PostgreSQL.
  • The JSON functions are now built-ins. It is no longer necessary to use the -DSQLITE_ENABLE_JSON1 compile-time option to enable JSON support. JSON is on by default. Disable the JSON interface using the new -DSQLITE_OMIT_JSON compile-time option.
  • Rename the printf() SQL function to format() for better compatibility. The original printf() name is retained as an alias for backwards compatibility.
  • Added the sqlite3_error_offset() interface, which can sometimes help to localize an SQL error to a specific character in the input SQL text, so that applications can provide better error messages.
  • Enhancements to date and time functions:
  • Added the unixepoch() function.
  • Added the auto modifier and the julianday modifier.
  • Enhanced the interface to virtual tables as follows:
  • Added the sqlite3_vtab_distinct() interface.
  • Added the sqlite3_vtab_rhs_value() interface.
  • Added new operator types SQLITE_INDEX_CONSTRAINT_LIMIT and SQLITE_INDEX_CONSTRAINT_OFFSET.
  • Added the sqlite3_vtab_in() interface (and related) to enable a virtual table to process IN operator constraints all at once, rather than processing each value of the right-hand side of the IN operator separately.
  • CLI enhancements:
  • Columnar output modes are enhanced to correctly handle tabs and newlines embedded in text.
  • Added options like "--wrap N", "--wordwrap on", and "--quote" to the columnar output modes.
  • Added the .mode qbox alias.
  • The .import command automatically disambiguates column names.
  • Use the new sqlite3_error_offset() interface to provide better error messages.
  • Query planner enhancements:
  • Use a Bloom filter to speed up large analytic queries.
  • Use a balanced merge tree to evaluate UNION or UNION ALL compound SELECT statements that have an ORDER BY clause.
  • The ALTER TABLE statement is changed to silently ignores entries in the sqlite_schema table that do not parse when PRAGMA writable_schema=ON.

New in SQLite 3.37.2 (Jan 7, 2022)

  • Fix a bug introduced in version 3.35.0 (2021-03-12) that can cause database corruption if a SAVEPOINT is rolled back while in PRAGMA temp_store=MEMORY mode, and other changes are made, and then the outer transaction commits. Check-in 73c2b50211d3ae26
  • Fix a long-standing problem with ON DELETE CASCADE and ON UPDATE CASCADE in which a cache of the bytecode used to implement the cascading change was not being reset following a local DDL change. Check-in 5232c9777fe4fb13.
  • Other minor fixes that should not impact production builds.

New in SQLite 3.37.1 (Dec 31, 2021)

  • Fix a bug introduced by the UPSERT enhancements of version 3.35.0 that can cause incorrect byte-code to be generated for some obscure but valid SQL, possibly resulting in a NULL-pointer dereference.
  • Fix an OOB read that can occur in FTS5 when reading corrupt database files.
  • Improved robustness of the --safe option in the CLI.
  • Other minor fixes to assert() statements and test cases.

New in SQLite 3.37.0 (Nov 29, 2021)

  • STRICT tables provide a prescriptive style of data type management, for developers who prefer that kind of thing.
  • When adding columns that contain a CHECK constraint or a generated column containing a NOT NULL constraint, the ALTER TABLE ADD COLUMN now checks new constraints against preexisting rows in the database and will only proceed if no constraints are violated.
  • Added the PRAGMA table_list statement.
  • Added the sqlite3_autovacuum_pages() interface.
  • The sqlite3_deserialize() does not and has never worked for the TEMP database. That limitation is now noted in the documentation.
  • The query planner now omits ORDER BY clauses on subqueries and views if removing those clauses does not change the semantics of the query.
  • The generate_series table-valued function extension is modified so that the first parameter ("START") is now required. This is done as a way to demonstrate how to write table-valued functions with required parameters. The legacy behavior is available using the -DZERO_ARGUMENT_GENERATE_SERIES compile-time option.
  • Added new sqlite3_changes64() and sqlite3_total_changes64() interfaces.
  • Added the SQLITE_OPEN_EXRESCODE flag option to sqlite3_open_v2().
  • Use less memory to hold the database schema.
  • CLI enhancements:
  • Add the .connection command, allowing the CLI to keep multiple database connections open at the same time.
  • Add the --safe command-line option that disables dot-commands and SQL statements that might cause side-effects that extend beyond the single database file named on the command-line.
  • Performance improvements when reading SQL statements that span many lines.

New in SQLite 3.36.0 (Jun 20, 2021)

  • Improvement to the EXPLAIN QUERY PLAN output to make it easier to understand.
  • Byte-order marks at the start of a token are skipped as if they were whitespace.
  • An error is raised on any attempt to access the rowid of a VIEW or subquery. Formerly, the rowid of a VIEW would be indeterminate and often would be NULL. The -DSQLITE_ALLOW_ROWID_IN_VIEW compile-time option is available to restore the legacy behavior for applications that need it.
  • The sqlite3_deserialize() and sqlite3_serialize() interfaces are now enabled by default. The -DSQLITE_ENABLE_DESERIALIZE compile-time option is no longer required. Instead, there is is a new -DSQLITE_OMIT_DESERIALIZE compile-time option to omit those interfaces.
  • The "memdb" VFS now allows the same in-memory database to be shared among multiple database connections in the same process as long as the database name begins with "/".
  • Back out the EXISTS-to-IN optimization (item 8b in the SQLite 3.35.0 change log) as it was found to slow down queries more often than speed them up.
  • Improve the constant-propagation optimization so that it works on non-join queries.
  • The REGEXP extension is now included in CLI builds.

New in SQLite 3.35.5 (Apr 20, 2021)

  • Fix defects in the new ALTER TABLE DROP COLUMN feature that could corrupt the database file.
  • Fix an obscure query optimizer problem that might cause an incorrect query result.

New in SQLite 3.35.4 (Apr 5, 2021)

  • Fix a defect in the query planner optimization identified by item 8b above. Ticket de7db14784a08053.
  • Fix a defect in the new RETURNING syntax. Ticket 132994c8b1063bfb.
  • Fix the new RETURNING feature so that it raises an error if one of the terms in the RETURNING clause references a unknown table, instead of silently ignoring that error.
  • Fix an assertion associated with aggregate function processing that was incorrectly triggered by the push-down optimization.

New in SQLite 3.35.3 (Mar 28, 2021)

  • Enhance the OP_OpenDup opcode of the bytecode engine so that it works even if the cursor being duplicated itself came from OP_OpenDup. Fix for ticket bb8a9fd4a9b7fce5. This problem only came to light due to the recent MATERIALIZED hint enhancement.
  • When materializing correlated common table expressions, do so separately for each use case, as that is required for correctness. This fixes a problem that was introduced by the MATERIALIZED hint enhancement.
  • Fix a problem in the filename normalizer of the unix VFS.
  • Fix the "box" output mode in the CLI so that it works with statements that returns one or more rows of zero columns (such as PRAGMA incremental_vacuum). Forum post afbbcb5b72.
  • Improvements to error messages generated by faulty common table expressions. Forum post aa5a0431c99e.
  • Fix some incorrect assert() statements.
  • Fix to the SELECT statement syntax diagram so that the FROM clause syntax is shown correctly. Forum post 9ed02582fe.
  • Fix the EBCDIC character classifier so that it understands newlines as whitespace. Forum post 58540ce22dcd.
  • Improvements the xBestIndex method in the implementation of the (unsupported) wholenumber virtual table extension so that it does a better job of convincing the query planner to avoid trying to materialize a table with an infinite number of rows. Forum post b52a020ce4.

New in SQLite 3.35.2 (Mar 19, 2021)

  • Fix a problem in the appendvfs.c extension that was introduced into version 3.35.0.
  • Ensure that date/time functions with no arguments (which generate responses that depend on the current time) are treated as non-deterministic functions. Ticket 2c6c8689fb5f3d2f
  • Fix a problem in the sqldiff utility program having to do with unusual whitespace characters in a virtual table definition.
  • Limit the new UNION ALL optimization described by item 8c in the 3.35.0 release so that it does not try to make too many new subqueries. See forum thread 140a67d3d2 for details.

New in SQLite 3.35.1 (Mar 16, 2021)

  • Fix a bug in the new DROP COLUMN feature when used on columns that are indexed and that are quoted in the index definition.
  • Documentation improvements.

New in SQLite 3.35.0 (Mar 14, 2021)

  • Added built-in SQL math functions(). (Requires the -DSQLITE_ENABLE_MATH_FUNCTIONS compile-time option.)
  • Added support for ALTER TABLE DROP COLUMN.
  • Generalize UPSERT:
  • Allow multiple ON CONFLICT clauses that are evaluated in order,
  • The final ON CONFLICT clause may omit the conflict target and yet still use DO UPDATE.
  • Add support for the RETURNING clause on DELETE, INSERT, and UPDATE statements.
  • Use less memory when running VACUUM on databases containing very large TEXT or BLOB values. It is no longer necessary to hold the entire TEXT or BLOB in memory all at once.
  • Add support for the MATERIALIZED and NOT MATERIALIZED hints when specifying common table expressions. The default behavior was formerly NOT MATERIALIZED, but is now changed to MATERIALIZED for CTEs that are used more than once.
  • The SQLITE_DBCONFIG_ENABLE_TRIGGER and SQLITE_DBCONFIG_ENABLE_VIEW settings are modified so that they only control triggers and views in the main database schema or in attached database schemas and not in the TEMP schema. TEMP triggers and views are always allowed.
  • Query planner/optimizer improvements:
  • Enhancements to the min/max optimization so that it works better with the IN operator and the OP_SeekScan optimization of the previous release.
  • Attempt to process EXISTS operators in the WHERE clause as if they were IN operators, in cases where this is a valid transformation and seems likely to improve performance.
  • Allow UNION ALL sub-queries to be flattened even if the parent query is a join.
  • Use an index, if appropriate, on IS NOT NULL expressions in the WHERE clause, even if STAT4 is disabled.
  • Expressions of the form "x IS NULL" or "x IS NOT NULL" might be converted to simply FALSE or TRUE, if "x" is a column that has a "NOT NULL" constraint and is not involved in an outer join.
  • Avoid checking foreign key constraints on an UPDATE statement if the UPDATE does not modify any columns associated with the foreign key.
  • Allow WHERE terms to be pushed down into sub-queries that contain window functions, as long as the WHERE term is made up of entirely of constants and copies of expressions found in the PARTITION BY clauses of all window functions in the sub-query.
  • CLI enhancements:
  • Enhance the ".stats" command to accept new arguments "stmt" and "vmstep", causing prepare statement statistics and only the virtual-machine step count to be shown, respectively.
  • Add the ".filectrl data_version" command.
  • Enhance the ".once" and ".output" commands so that if the destination argument begins with "|" (indicating that output is redirected into a pipe) then the argument does not need to be quoted.
  • Bug fixes:
  • Fix a potential NULL pointer dereference when processing a syntactically incorrect SELECT statement with a correlated WHERE clause and a "HAVING 0" clause. (Also fixed in the 3.34.1 patch release.)
  • Fix a bug in the IN-operator optimization of version 3.33.0 that can cause an incorrect answer.
  • Fix incorrect answers from the LIKE operator if the pattern ends with "%" and there is an "ESCAPE '_'" clause.

New in SQLite 3.34.1 (Jan 21, 2021)

  • Fix a potential use-after-free bug when processing a a subquery with both a correlated WHERE clause and a "HAVING 0" clause and where the parent query is an aggregate.
  • Fix documentation typos
  • Fix minor problems in extensions.

New in SQLite 3.34.0 (Dec 2, 2020)

  • Added the sqlite3_txn_state() interface for reporting on the current transaction state of the database connection.
  • Enhance recursive common table expressions to support two or more recursive terms as is done by SQL Server, since this helps make queries against graphs easier to write and faster to execute.
  • Improved error messages on CHECK constraint failures.
  • The BEGIN IMMEDIATE and BEGIN EXCLUSIVE commands now work even if one or more attached database files are read-only.
  • Enhanced FTS5 to support trigram indexes.
  • Improved performance of WAL mode locking primitives in cases where there are hundreds of connections all accessing the same database file at once.
  • Enhanced the carray() table-valued function to include a single-argument form that is bound using the auxiliary sqlite3_carray_bind() interface.
  • The substr() SQL function can now also be called "substring()" for compatibility with SQL Server.
  • The syntax diagrams are now implemented as Pikchr scripts and rendered as SVG for improved legibility and ease of maintenance.
  • CLI enhancements:
  • The .read dot-command now accepts a pipeline in addition to a filename.
  • Added options --data-only and --nosys to the .dump dot-command.
  • Added the --nosys option to the .schema dot-command.
  • Table name quoting works correctly for the .import dot-command.
  • The generate_series(START,END,STEP) table-valued function extension is now built into the CLI.
  • The .databases dot-command now show the status of each database file as determined by sqlite3_db_readonly() and sqlite3_txn_state().
  • Added the --tabs command-line option that sets .mode tabs.
  • The --init option reports an error if the file named as its argument cannot be opened. The --init option also now honors the --bail option.
  • Query planner improvements:
  • Improved estimates for the cost of running a DISTINCT operator.
  • When doing an UPDATE or DELETE using a multi-column index where only a few of the earlier columns of the index are useful for the index lookup, postpone doing the main table seek until after all WHERE clause constraints have been evaluated, in case those constraints can be covered by unused later terms of the index, thus avoiding unnecessary main table seeks.
  • The new OP_SeekScan opcode is used to improve performance of multi-column index look-ups when later columns are constrained by an IN operator.

New in SQLite 3.33.0 (Aug 14, 2020)

  • Support for UPDATE FROM following the PostgreSQL syntax.
  • Increase the maximum size of database files to 281 TB.
  • Extended the PRAGMA integrity_check statement so that it can optionally be limited to verifying just a single table and its indexes, rather than the entire database file.
  • Added the decimal extension for doing arbitrary-precision decimal arithmetic.
  • Enhancements to the ieee754 extension for working with IEEE 754 binary64 numbers.
  • CLI enhancements:
  • Added four new output modes: "box", "json", "markdown", and "table".
  • The "column" output mode automatically expands columns to contain the longest output row and automatically turns ".header" on if it has not been previously set.
  • The "quote" output mode honors ".separator"
  • The decimal extension and the ieee754 extension are built-in to the CLI
  • Query planner improvements:
  • Add the ability to find a full-index-scan query plan for queries using INDEXED BY which previously would fail with "no query solution".
  • Do a better job of detecting missing, incomplete, and/or dodgy sqlite_stat1 data and generates good query plans in spite of the misinformation.
  • Improved performance of queries like "SELECT min(x) FROM t WHERE y IN (?,?,?)" assuming an index on t(x,y).
  • Other:
  • In WAL mode, if a writer crashes and leaves the shm file in an inconsistent state, subsequent transactions are now able to recover the shm file even if there are active read transactions. Before this enhancement, shm file recovery that scenario would result in an SQLITE_PROTOCOL error.

New in SQLite 3.32.3 (Jun 18, 2020)

  • Various minor bug fixes including fixes for tickets

New in SQLite 3.32.2 (Jun 7, 2020)

  • Fix a long-standing bug in the byte-code engine that can cause a COMMIT command report as success when in fact it failed to commit.

New in SQLite 3.32.1 (May 26, 2020)

  • Fix two long-standing bugs that allow malicious SQL statements to crash the process that is running SQLite. These bugs were announced by a third-party approximately 24 hours after the 3.32.0 release but are not specific to the 3.32.0 release.
  • Other minor compiler-warning fixes and whatnot.

New in SQLite 3.32.0 (May 25, 2020)

  • Added support for approximate ANALYZE using the PRAGMA analysis_limit command.
  • Added the bytecode virtual table.
  • Add the checksum VFS shim to the set of run-time loadable extensions included in the source tree.
  • Added the iif() SQL function.
  • INSERT and UPDATE statements now always apply column affinity before computing CHECK constraints. This bug fix could, in theory, cause problems for legacy databases with unorthodox CHECK constraints the require the input type for an INSERT is different from the declared column type. See ticket 86ba67afafded936 for more information.
  • Added the sqlite3_create_filename(), sqlite3_free_filename(), and sqlite3_database_file_object() interfaces to better support of VFS shim implementations.
  • Increase the default upper bound on the number of parameters from 999 to 32766.
  • Added code for the UINT collating sequence as an optional loadable extension.
  • The ESCAPE clause of a LIKE operator now overrides wildcard characters, so that the behavior now matches what PostgreSQL does.
  • Enhancements to the CLI:
  • Add options to the .import command: --csv, --ascii, --skip
  • The .dump command now accepts multiple LIKE-pattern arguments and outputs the union of all matching tables.
  • Add the .oom command in debugging builds
  • Add the --bom option to the .excel, .output, and .once commands.
  • Enhance the .filectrl command to support the --schema option.
  • The UINT collating sequence extension is automatically loaded

New in SQLite 3.31.1 (Jan 28, 2020)

  • Revert the data layout for an internal-use-only SQLite data structure. Applications that use SQLite should never reference internal SQLite data structures, but some do anyhow, and a change to one such data structure in 3.30.0 broke a popular and widely-deployed application. Reverting that change in SQLite, at least temporarily, gives developers of misbehaving applications time to fix their code.
  • Fix a typos in the sqlite3ext.h header file that prevented the sqlite3_stmt_isexplain() and sqlite3_value_frombind() interfaces from being called from run-time loadable extensions.

New in SQLite 3.31.0 (Jan 23, 2020)

  • Add support for generated columns.
  • Add the sqlite3_hard_heap_limit64() interface and the corresponding PRAGMA hard_heap_limit command.
  • Enhance the function_list pragma to show the number of arguments on each function, the type of function (scalar, aggregate, window), and the function property flags SQLITE_DETERMINISTIC, SQLITE_DIRECTONLY, SQLITE_INNOCUOUS, and/or SQLITE_SUBTYPE.
  • Add the aggregated mode feature to the DBSTAT virtual table.
  • Add the SQLITE_OPEN_NOFOLLOW option to sqlite3_open_v2() that prevents SQLite from opening symbolic links.
  • Added the "#-N" array notation for JSON function path arguments.
  • Added the SQLITE_DBCONFIG_TRUSTED_SCHEMA connection setting which is also controllable via the new trusted_schema pragma and at compile-time using the -DSQLITE_TRUSTED_SCHEMA compile-time option.
  • Added APIs sqlite3_filename_database(), sqlite3_filename_journal(), and sqlite3_filename_wal() which are useful for specialized extensions.
  • Add the sqlite3_uri_key() interface.
  • Upgraded the sqlite3_uri_parameter() function so that it works with the rollback journal or WAL filename in addition to the database filename.
  • Provide the ability to tag application-defined SQL functions with new properties SQLITE_INNOCUOUS or SQLITE_DIRECTONLY.
  • Add new verbs to sqlite3_vtab_config() so that the xConnect method of virtual tables can declare the virtual table as SQLITE_VTAB_INNOCUOUS or SQLITE_VTAB_DIRECTONLY.
  • Faster response to sqlite3_interrupt().
  • Added the uuid.c extension module implementing functions for processing RFC-4122 UUIDs.
  • The lookaside memory allocator is enhanced to support two separate memory pools with different sized allocations in each pool. This allows more memory allocations to be covered by lookaside while at the same time reducing the heap memory usage to 48KB per connection, down from 120KB.
  • The legacy_file_format pragma is deactivated. It is now a no-op. In its place, the SQLITE_DBCONFIG_LEGACY_FILE_FORMAT option to sqlite3_db_config() is provided. The legacy_file_format pragma is deactivated because (1) it is rarely useful and (2) it is incompatible with VACUUM in schemas that have tables with both generated columns and descending indexes. Ticket 6484e6ce678fffab

New in SQLite 3.30.1 (Oct 11, 2019)

  • Fix a bug in the query flattener that might cause a segfault for nested queries that use the new FILTER clause on aggregate functions. Ticket 1079ad19993d13fa
  • Cherrypick fixes for other obscure problems found since the 3.30.0 release

New in SQLite 3.30.0 (Oct 9, 2019)

  • Add support for the FILTER clause on aggregate functions.
  • Add support for the NULLS FIRST and NULLS LAST syntax in ORDER BY clauses.
  • The index_info and index_xinfo pragmas are enhanced to provide information about the on-disk representation of WITHOUT ROWID tables.
  • Add the sqlite3_drop_modules() interface, allowing applications to disable automatically loaded virtual tables that they do not need.
  • Improvements to the .recover dot-command in the CLI so that it recovers more content from corrupt database files.
  • Enhance the RBU extension to support indexes on expressions.
  • Change the schema parser so that it will error out if any of the type, name, and tbl_name columns of the sqlite_master table have been corrupted and the database connection is not in writable_schema mode.
  • The PRAGMA function_list, PRAGMA module_list, and PRAGMA pragma_list commands are now enabled in all builds by default. Disable them using -DSQLITE_OMIT_INTROSPECTION_PRAGMAS.
  • Add the SQLITE_DBCONFIG_ENABLE_VIEW option for sqlite3_db_config().
  • Added the TCL Interface config method in order to be able to disable SQLITE_DBCONFIG_ENABLE_VIEW as well as control other sqlite3_db_config() options from TCL.
  • Added the SQLITE_DIRECTONLY flag for application-defined SQL functions to prevent those functions from being used inside triggers and views.
  • The legacy SQLITE_ENABLE_STAT3 compile-time option is now a no-op.

New in SQLite 3.29.0 (Jul 17, 2019)

  • Added the SQLITE_DBCONFIG_DQS_DML and SQLITE_DBCONFIG_DQS_DDL actions to sqlite3_db_config() for activating and deactivating the double-quoted string literal misfeature. Both default to "on" for legacy compatibility, but developers are encouraged to turn them "off", perhaps using the -DSQLITE_DQS=0 compile-time option.
  • -DSQLITE_DQS=0 is now a recommended compile-time option.
  • Added the "sqlite_dbdata" virtual table for extracting raw low-level content from an SQLite database, even a database that is corrupt.
  • Improvements to the query planner:
  • Improved optimization of AND and OR operators when one or the other operand is a constant.
  • Enhancements to the LIKE optimization for cases when the left-hand side column has numeric affinity.
  • Enhancements to the CLI:
  • Add the ".recover" command which tries to recover as much content as possible from a corrupt database file.
  • Add the ".filectrl" command useful for testing.
  • Add the long-standing ".testctrl" command to the ".help" menu.
  • Added the ".dbconfig" command

New in SQLite 3.28.0 (Jul 17, 2019)

  • Enhanced window functions:
  • Add support the EXCLUDE clause.
  • Add support for window chaining.
  • Add support for GROUPS frames.
  • Add support for " PRECEDING" and " FOLLOWING" boundaries in RANGE frames.
  • Added the new sqlite3_stmt_isexplain(S) interface for determining whether or not a prepared statement is an EXPLAIN.
  • Enhanced VACUUM INTO so that it works for read-only databases.
  • New query optimizations:
  • Enable the LIKE optimization for cases when the ESCAPE keyword is present and PRAGMA case_sensitive_like is on.
  • In queries that are driven by a partial index, avoid unnecessary tests of the constraint named in the WHERE clause of the partial index, since we know that constraint must always be true.
  • Enhancements to the TCL Interface:
  • Added the -returntype option to the function method.
  • Added the new bind_fallback method.
  • Enhancements to the CLI:
  • Added support for bound parameters and the .parameter command.
  • Fix the readfile() function so that it returns an empty BLOB rather than throwing an out-of-memory error when reading an empty file.
  • Fix the writefile() function so that when it creates new directories along the path of a new file, it gives them umask permissions rather than the same permissions as the file.
  • Change --update option in the .archive command so that it skips files that are already in the archive and are unchanged. Add the new --insert option that works like --update used to work.
  • Added the fossildelta.c extension that can create, apply, and deconstruct the Fossil DVCS file delta format that is used by the RBU extension.
  • Added the SQLITE_DBCONFIG_WRITABLE_SCHEMA verb for the sqlite3_db_config() interface, that does the same work as PRAGMA writable_schema without using the SQL parser.
  • Added the sqlite3_value_frombind() API for determining if the argument to an SQL function is from a bound parameter.
  • Security and compatibilities enhancements to fts3_tokenizer():
  • The fts3_tokenizer() function always returns NULL unless either the legacy application-defined FTS3 tokenizers interface are enabled using the sqlite3_db_config(SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER) setting, or unless the first argument to fts3_tokenizer() is a bound parameter.
  • The two-argument version of fts3_tokenizer() accepts a pointer to the tokenizer method object even without the sqlite3_db_config(SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER) setting if the second argument is a bound parameter
  • Improved robustness against corrupt database files.
  • Miscellaneous performance enhancements
  • Established a Git mirror of the offical SQLite source tree. The canonical sources for SQLite are maintained using the Fossil DVCS at https://sqlite.org/src. The Git mirror can be seen at https://github.com/sqlite/sqlite.

New in SQLite 3.27.2 (Jul 17, 2019)

  • Fix a bug in the IN operator that was introduced by an attempted optimization in version 3.27.0. Ticket df46dfb631f75694
  • Fix a bug causing a crash when a window function is misused. Ticket 4feb3159c6bc3f7e33959.
  • Fix various documentation typos

New in SQLite 3.27.1 (Jul 17, 2019)

  • Fix a bug in the query optimizer: an adverse interaction between the OR optimization and the optimization that tries to use values read directly from an expression index instead of recomputing the expression. Ticket 4e8e4857d32d401f

New in SQLite 3.27.0 (Jul 17, 2019)

  • Added the VACUUM INTO command
  • Issue an SQLITE_WARNING message on the error log if a double-quoted string literal is used.
  • The sqlite3_normalized_sql() interface works on any prepared statement created using sqlite3_prepare_v2() or sqlite3_prepare_v3(). It is no longer necessary to use sqlite3_prepare_v3() with SQLITE_PREPARE_NORMALIZE in order to use sqlite3_normalized_sql().
  • Added the remove_diacritics=2 option to FTS3 and FTS5.
  • Added the SQLITE_PREPARE_NO_VTAB option to sqlite3_prepare_v3(). Use that option to prevent circular references to shadow tables from causing resource leaks.
  • Enhancements to the sqlite3_deserialize() interface:
  • Add the SQLITE_FCNTL_SIZE_LIMIT file-control for setting an upper bound on the size of the in-memory database created by sqlite3_deserialize. The default upper bound is 1GiB, or whatever alternative value is specified by sqlite3_config(SQLITE_CONFIG_MEMDB_MAXSIZE) and/or SQLITE_MEMDB_DEFAULT_MAXSIZE.
  • Honor the SQLITE_DESERIALIZE_READONLY flag, which was previously described in the documentation, but was previously a no-op.
  • Enhance the "deserialize" command of the TCL Interface to give it new "--maxsize N" and "--readonly BOOLEAN" options.
  • Enhancements to the CLI, mostly to support testing and debugging of the SQLite library itself:
  • Add support for ".open --hexdb". The "dbtotxt" utility program used to generate the text for the "hexdb" is added to the source tree.
  • Add support for the "--maxsize N" option on ".open --deserialize".
  • Add the "--memtrace" command-line option, to show all memory allocations and deallocations.
  • Add the ".eqp trace" option on builds with SQLITE_DEBUG, to enable bytecode program listing with indentation and PRAGMA vdbe_trace all in one step.
  • Add the ".progress" command for accessing the sqlite3_progress_handler() interface.
  • Add the "--async" option to the ".backup" command.
  • Add options "--expanded", "--normalized", "--plain", "--profile", "--row", "--stmt", and "--close" to the ".trace" command.
  • Increased robustness against malicious SQL that is run against a maliciously corrupted database.
  • Bug fixes:
  • Do not use a partial index to do a table scan on an IN operator. Ticket 1d958d90596593a774.
  • Fix the query flattener so that it works on queries that contain subqueries that use window functions. Ticket 709fcd17810f65f717
  • Ensure that ALTER TABLE modifies table and column names embedded in WITH clauses that are part of views and triggers.
  • Fix a parser bug that prevented the use of parentheses around table-valued functions.
  • Fix a problem with the OR optimization on indexes on expressions. Ticket d96eba87698a428c1d.
  • Fix a problem with the LEFT JOIN strength reduction optimization in which the optimization was being applied inappropriately due to an IS NOT NULL operator. Ticket 5948e09b8c415bc45d.
  • Fix the REPLACE command so that it is no longer able to sneak a NULL value into a NOT NULL column even if the NOT NULL column has a default value of NULL. Ticket e6f1f2e34dceeb1ed6
  • Fix a problem with the use of window functions used within correlated subqueries. Ticket d0866b26f83e9c55e3
  • Fix the ALTER TABLE RENAME COLUMN command so that it works for tables that have redundant UNIQUE constraints. Ticket bc8d94f0fbd633fd9a
  • Fix a bug that caused zeroblob values to be truncated when inserted into a table that uses an expression index. Ticket bb4bdb9f7f654b0bb9

New in SQLite 3.26.0 (Dec 28, 2018)

  • Optimization: When doing an UPDATE on a table with indexes on expressions, do not update the expression indexes if they do not refer to any of the columns of the table being updated.
  • Allow the xBestIndex() method of virtual table implementations to return SQLITE_CONSTRAINT to indicate that the proposed query plan is unusable and should not be given further consideration.
  • Added the SQLITE_DBCONFIG_DEFENSIVE option which disables the ability to create corrupt database files using ordinary SQL.
  • Added support for read-only shadow tables when the SQLITE_DBCONFIG_DEFENSIVE option is enabled.
  • Added the PRAGMA legacy_alter_table command, which if enabled causes the ALTER TABLE command to behave like older version of SQLite (prior to version 3.25.0) for compatibility.
  • Added PRAGMA table_xinfo that works just like PRAGMA table_info except that it also shows hidden columns in virtual tables.
  • Added the explain virtual table as a run-time loadable extension.
  • Add a limit counter to the query planner to prevent excessive sqlite3_prepare() times for certain pathological SQL inputs.
  • Added support for the sqlite3_normalized_sql() interface, when compiling with SQLITE_ENABLE_NORMALIZE.
  • Enhanced triggers so that they can use table-valued functions that exist in schemas other than the schema where the trigger is defined.
  • Enhancements to the CLI:
  • Improvements to the ".help" command.
  • The SQLITE_HISTORY environment variable, if it exists, specifies the name of the command-line editing history file
  • The --deserialize option associated with opening a new database cause the database file to be read into memory and accessed using the sqlite3_deserialize() API. This simplifies running tests on a database without modifying the file on disk.
  • Enhancements to the geopoly extension:
  • Aways stores polygons using the binary format, which is faster and uses less space.
  • Added the geopoly_regular() function.
  • Added the geopoly_ccw() function.
  • Enhancements to the session extension:
  • Added the SQLITE_CHANGESETAPPLY_INVERT flag
  • Added the sqlite3changeset_start_v2() interface and the SQLITE_CHANGESETSTART_INVERT flag.
  • Added the changesetfuzz.c test-case generator utility.

New in SQLite 3.25.3 (Dec 28, 2018)

  • Disallow the use of window functions in the recursive part of a CTE. Ticket e8275b415a2f03bee
  • Fix the behavior of typeof() and length() on virtual tables. Ticket 69d642332d25aa3b7315a6d385
  • Strengthen defenses against deliberately corrupted database files.
  • Fix a problem in the query planner that results when a row-value expression is used with a PRIMARY KEY with redundant columns. Ticket 1a84668dcfdebaf12415d
  • Fix the query planner so that it works correctly for IS NOT NULL operators in the ON clause of a LEFT JOIN with the SQLITE_ENABLE_STAT4 compile-time option. 65eb38f6e46de8c75e188a17ec

New in SQLite 3.25.2 (Dec 28, 2018)

  • Add the PRAGMA legacy_alter_table=ON command that causes the "ALTER TABLE RENAME" command to behave as it did in SQLite versions 3.24.0 and earlier: references to the renamed table inside the bodies of triggers and views are not updated. This new pragma provides a compatibility work around for older programs that expected the older, wonky behavior of ALTER TABLE RENAME.
  • Fix a problem with the new window functions implementation that caused a malfunction when complicated expressions involving window functions were used inside of a view.
  • Fixes for various other compiler warnings and minor problems associated with obscure configurations.

New in SQLite 3.25.1 (Dec 28, 2018)

  • Extra sanity checking added to ALTER TABLE in the 3.25.0 release sometimes raises a false-positive when the table being modified has a trigger that updates a virtual table. The false-positive caused the ALTER TABLE to rollback, thus leaving the schema unchanged. Ticket b41031ea2b537237.
  • The fix in the 3.25.0 release for the endless-loop in the byte-code associated with the ORDER BY LIMIT optimization did not work for some queries involving window functions. An additional correction is required. Ticket 510cde277783b5fb

New in SQLite 3.25.0 (Sep 17, 2018)

  • Use a separate mutex on every inode in the unix VFS, rather than a single mutex shared among them all, for slightly better concurrency in multi-threaded environments.
  • Enhance the PRAGMA integrity_check command for improved detection of problems on the page freelist.
  • Output infinity as 1e999 in the ".dump" command of the command-line shell.
  • Added the SQLITE_FCNTL_DATA_VERSION file-control.
  • Added the Geopoly module
  • Add support for window functions:
  • Enhancements the ALTER TABLE command:
  • Add support for renaming columns within a table using ALTER TABLE table RENAME COLUMN oldname TO newname.
  • Fix table rename feature so that it also updates references to the renamed table in triggers and views.
  • Query optimizer improvements:
  • Avoid unnecessary loads of columns in an aggregate query that are not within an aggregate function and that are not part of the GROUP BY clause.
  • The IN-early-out optimization: When doing a look-up on a multi-column index and an IN operator is used on a column other than the left-most column, then if no rows match against the first IN value, check to make sure there exist rows that match the columns to the right before continuing with the next IN value.
  • Use the transitive property to try to propagate constant values within the WHERE clause. For example, convert "a=99 AND b=a" into "a=99 AND b=99".
  • Bug fixes:
  • The ORDER BY LIMIT optimization might have caused an infinite loop in the byte code of the prepared statement under very obscure circumstances, due to a confluence of minor defects in the query optimizer. Fix for ticket 9936b2fa443fec03ff25
  • On an UPSERT when the order of constraint checks is rearranged, ensure that the affinity transformations on the inserted content occur before any of the constraint checks. Fix for ticket 79cad5e4b2e219dd197242e9e.
  • Avoid using a prepared statement for ".stats on" command of the CLI after it has been closed by the ".eqp full" logicc. Fix for ticket 7be932dfa60a8a6b3b26bcf76.
  • The LIKE optimization was generating incorrect byte-code and hence getting the wrong answer if the left-hand operand has numeric affinity and the right-hand-side pattern is '/%' or if the pattern begins with the ESCAPE character. Fix for ticket c94369cae9b561b1f996d0054b

New in SQLite 3.24.0 (Jun 5, 2018)

  • Add support for PostgreSQL-style UPSERT.
  • Add support for auxiliary columns in r-tree tables.
  • Add C-language APIs for discovering SQL keywords used by SQLite: sqlite3_keyword_count(), sqlite3_keyword_name(), and sqlite3_keyword_check().
  • Add C-language APIs for dynamic strings based on the sqlite3_str object.
  • Enhance ALTER TABLE so that it recognizes "true" and "false" as valid arguments to DEFAULT.
  • Add the sorter-reference optimization as a compile-time option. Only available if compiled with SQLITE_ENABLE_SORTER_REFERENCES.
  • Improve the format of the EXPLAIN QUERY PLAN raw output, so that it gives better information about the query plan and about the relationships between the various components of the plan.
  • Added the SQLITE_DBCONFIG_RESET_DATABASE option to the sqlite3_db_config() API.
  • CLI Enhancements:
  • Automatically intercepts the raw EXPLAIN QUERY PLAN output and reformats it into an ASCII-art graph.
  • Lines that begin with "#" and that are not in the middle of an SQL statement are interpreted as comments.
  • Added the --append option to the ".backup" command.
  • Added the ".dbconfig" command.
  • Performance:
  • UPDATE avoids writing database pages that do not actually change. For example, "UPDATE t1 SET x=25 WHERE y=?" becomes a no-op if the value in column x is already 25. Similarly, when doing UPDATE on records that span multiple pages, only write the subset of pages that contain the changed value(s).
  • Queries that use ORDER BY and LIMIT now try to avoid computing rows that cannot possibly come in under the LIMIT. This can greatly improve performance of ORDER BY LIMIT queries, especially when the LIMIT is small relative to the number of unrestricted output rows.
  • The OR optimization is allowed to proceed even if the OR expression has also been converted into an IN expression. Uses of the OR optimization are now also more clearly shown in the EXPLAIN QUERY PLAN output.
  • The query planner is more aggressive about using automatic indexes for views and subqueries for which it is not possible to create a persistent index.
  • Make use of the one-pass UPDATE and DELETE query plans in the R-Tree extension where appropriate.
  • Performance improvements in the LEMON-generated parser.
  • Bug fixes:
  • For the right-hand table of a LEFT JOIN, compute the values of expressions directly rather than loading precomputed values out of an expression index as the expression index might not contain the correct value. Ticket 7fa8049685b50b5aeb0c2
  • Do not attempt to use terms from the WHERE clause to enable indexed lookup of the right-hand table of a LEFT JOIN. Ticket 4ba5abf65c5b0f9a96a7a
  • Fix a memory leak that can occur following a failure to open error in the CSV virtual table
  • Fix a long-standing problem wherein a corrupt schema on the sqlite_sequence table used by AUTOINCREMENT can lead to a crash. Ticket d8dc2b3a58cd5dc2918a1
  • Fix the json_each() function so that it returns valid results on its "fullkey" column when the input is a simple value rather than an array or object.

New in SQLite 3.23.1 (May 1, 2018)

  • Fix two problems in the new LEFT JOIN strength reduction optimization. Tickets 1e39b966ae9ee739 and fac496b61722daf2.
  • Fix misbehavior of the FTS5 xBestIndex method. Ticket 2b8aed9f7c9e61e8.
  • Fix a harmless reference to an uninitialized virtual machine register. Ticket 093420fc0eb7cba7.
  • Fix the CLI so that it builds with -DSQLITE_UNTESTABLE
  • Fix the eval.c extension so that it works with PRAGMA empty_result_callbacks=ON.
  • Fix the generate_series virtual table so that it correctly returns no rows if any of its constraints are NULL.
  • Performance enhancements in the parser.

New in SQLite 3.22.0 (Jan 23, 2018)

  • The output of sqlite3_trace_v2() now shows each individual SQL statement run within a trigger.
  • Add the ability to read from WAL mode databases even if the application lacks write permission on the database and its containing directory, as long as the -shm and -wal files exist in that directory.
  • Added the rtreecheck() scalar SQL function to the R-Tree extension.
  • Added the sqlite3_vtab_nochange() and sqlite3_value_nochange() interfaces to help virtual table implementations optimize UPDATE operations.
  • Added the sqlite3_vtab_collation() interface.
  • Added support for the "^" initial token syntax in FTS5.
  • Enhance the SQLITE_ENABLE_UPDATE_DELETE_LIMIT compile-time option so that it works for WITHOUT ROWID tables.
  • Provide the sqlite_offset(X) SQL function that returns the byte offset into the database file to the beginning of the record holding value X, when compiling with -DSQLITE_ENABLE_OFFSET_SQL_FUNC.
  • New extensions:
  • The Zipfile virtual table can read and write a ZIP Archive.
  • Added the fsdir(PATH) table-valued function to the fileio.c extension, for listing the files in a directory.
  • The sqlite_btreeinfo eponymous virtual table for introspecting and estimating the sizes of the btrees in a database.
  • The Append VFS is a VFS shim that allows an SQLite database to be appended to some other file. This allows (for example) a database to be appended to an executable that then opens and reads the database.
  • Query planner enhancements:
  • The optimization that uses an index to quickly compute an aggregate min() or max() is extended to work with indexes on expressions.
  • The decision of whether to implement a FROM-clause subquery as a co-routine or using query flattening now considers whether the result set of the outer query is "complex" (if it contains functions or expression subqueries). A complex result set biases the decision toward the use of co-routines.
  • The planner avoids query plans that use indexes with unknown collating functions.
  • The planner omits unused LEFT JOINs even if they are not the right-most joins of a query.
  • Other performance optimizations:
  • A smaller and faster implementation of text to floating-point conversion subroutine: sqlite3AtoF().
  • The Lemon parser generator creates a faster parser.
  • Use the strcspn() C-library routine to speed up the LIKE and GLOB operators.
  • Improvements to the command-line shell:
  • The ".schema" command shows the structure of virtual tables.
  • Added support for reading and writing SQL Archive files using the .archive command.
  • Added the experimental .expert command
  • Added the ".eqp trigger" variant of the ".eqp" command
  • Enhance the ".lint fkey-indexes" command so that it works with WITHOUT ROWID tables.
  • If the filename argument to the shell is a ZIP archive rather than an SQLite database, then the shell automatically opens that ZIP archive using the Zipfile virtual table.
  • Added the edit() SQL function.
  • Added the .excel command to simplify exporting database content to a spreadsheet.
  • Databases are opened using Append VFS when the --append flag is used on the command line or with the .open command.
  • Bug fixes:
  • Infinite loop on an UPDATE that uses an OR operator in the WHERE clause. Problem introduced with 3.17.0 and reported on the mailing list about one year later. Ticket 47b2581aa9bfecec.
  • Incorrect query results when the skip-ahead-distinct optimization is used. Ticket ef9318757b152e3a.
  • Incorrect query results on a join with a ORDER BY DESC. Ticket 123c9ba32130a6c9.
  • Inconsistent result set column names between CREATE TABLE AS and a simple SELECT. Ticket 3b4450072511e621
  • Assertion fault when doing REPLACE on an index on an expression. Ticket dc3f932f5a147771
  • Assertion fault when doing an IN operator on a constant index. Ticket aa98619ad08ddcab

New in SQLite 3.21.0 (Oct 25, 2017)

  • Take advantage of the atomic-write capabilities in the F2FS filesystem when available, for greatly reduced transaction overhead. This currently requires the SQLITE_ENABLE_BATCH_ATOMIC_WRITE compile-time option.
  • 2. Allow ATTACH and DETACH commands to work inside of a transaction.
  • 3. Allow WITHOUT ROWID virtual tables to be writable if the PRIMARY KEY contains exactly one column.
  • 4. The "fsync()" that occurs after the header is written in a WAL reset now uses the sync settings for checkpoints. This means it will use a "fullfsync" on macs if PRAGMA checkpoint_fullfsync set on.
  • 5. The sqlite3_sourceid() function tries to detect if the source code has been modified from what is checked into version control and if there are modifications, the last four characters of the version hash are shown as "alt1" or "alt2". The objective is to detect accidental and/or careless edits. A forger can subvert this feature.
  • 6. Improved de-quoting of column names for CREATE TABLE AS statements with an aggregate query on the right-hand side.
  • 7. Fewer "stat()" system calls issued by the unix VFS.
  • 8. Enhanced the LIKE optimization so that it works with an ESCAPE clause.
  • 9. Enhanced PRAGMA integrity_check and PRAGMA quick_check to detect obscure row corruption that they were formerly missing. Also update both pragmas so that they return error text rather than SQLITE_CORRUPT when encountering corruption in records.
  • The query planner now prefers to implement FROM-clause subqueries using co-routines rather using the query flattener optimization. Support for the use of co-routines for subqueries may no longer be disabled.
  • Pass information about !=, IS, IS NOT, NOT NULL, and IS NULL constraints into the xBestIndex method of virtual tables.
  • Enhanced the CSV virtual table so that it accepts the last row of input if the final new-line character is missing.
  • Remove the rarely-used "scratch" memory allocator. Replace it with the SQLITE_CONFIG_SMALL_MALLOC configuration setting that gives SQLite a hint that large memory allocations should be avoided when possible.
  • Added the swarm virtual table to the existing union virtual table extension.
  • Added the sqlite_dbpage virtual table for providing direct access to pages of the database file. The source code is built into the amalgamation and is activated using the -DSQLITE_ENABLE_DBPAGE_VTAB compile-time option.
  • Add a new type of fts5vocab virtual table - "instance" - that provides direct access to an FTS5 full-text index at the lowest possible level.
  • Remove a call to rand_s() in the Windows VFS since it was causing problems in Firefox on some older laptops.
  • The src/shell.c source code to the command-line shell is no longer under version control. That file is now generated as part of the build process.
  • Miscellaneous microoptimizations reduce CPU usage by about 2.1%.
  • Bug fixes:
  • Fix a faulty assert() statement discovered by OSSFuzz.
  • Fix an obscure memory leak in sqlite3_result_pointer().
  • Avoid a possible use-after-free error by deferring schema resets until after the query planner has finished running.
  • Only use indexes-on-expressions to optimize ORDER BY or GROUP BY if the COLLATE is correct.
  • Fix an assertion fault that was coming up when the expression in an index-on-expressions is really a constant.
  • Fix an assertion fault that could occur following PRAGMA reverse_unordered_selects.
  • Fix a segfault that can occur for queries that use table-valued functions in an IN or EXISTS subquery.
  • Fix a potential integer overflow problem when compiling a particular horrendous common table expression. This was another problem discovered by OSSFuzz.
  • Fix a potential out-of-bound read when querying a corrupt database file, a problem detected by Natalie Silvanovich of Google Project Zero.

New in SQLite 3.20.1 (Sep 1, 2017)

  • Fix a potential memory leak in the new sqlite3_result_pointer() interface.

New in SQLite 3.20.0 (Aug 2, 2017)

  • Update the text of error messages returned by sqlite3_errmsg() for some error codes.
  • Add new pointer passing interfaces.
  • Added the SQLITE_STMT virtual table extension.
  • Added the COMPLETION extension - designed to suggest tab-completions for interactive user interfaces. This is a work in progress. Expect further enhancements in future releases.
  • Added the UNION virtual table extension.
  • The built-in date and time functions have been enhanced so that they can be used in CHECK constraints, in indexes on expressions, and in the WHERE clauses of partial indexes, provided that they do not use the 'now', 'localtime', or 'utc' keywords. Futher information.
  • Added the sqlite3_prepare_v3() and sqlite3_prepare16_v3() interfaces with the extra "prepFlags" parameters.
  • Provide the SQLITE_PREPARE_PERSISTENT flag for sqlite3_prepare_v3() and use it to limit lookaside memory misuse by FTS3, FTS5, and the R-Tree extension.
  • Added the PRAGMA secure_delete=FAST command. When secure_delete is set to FAST, old content is overwritten with zeros as long as that does not increase the amount of I/O. Deleted content might still persist on the free-page list but will be purged from all b-tree pages.
  • Add SQLITE_STMTSTATUS_REPREPARE, SQLITE_STMTSTATUS_RUN, and SQLITE_STMTSTATUS_MEMUSED options for the sqlite3_stmt_status() interface.
  • Provide PRAGMA functions for PRAGMA integrity_check, PRAGMA quick_check, and PRAGMA foreign_key_check.
  • Add the -withoutnulls option to the TCL interface eval method.
  • Enhance the sqlite3_analyzer.exe utility program so that it shows the number of bytes of metadata on btree pages.
  • The SQLITE_DBCONFIG_ENABLE_QPSG run-time option and the SQLITE_ENABLE_QPSG compile-time option enable the query planner stability guarantee. See also ticket 892fc34f173e99d8
  • Miscellaneous optimizations result in a 2% reduction in CPU cycles used.
  • Backwards-incompatible changes to some extensions in order to take advantage of the improved security offered by the new pointer passing interfaces:
  • Extending FTS5 → requires sqlite3_bind_pointer() to find the fts5_api pointer.
  • carray(PTR,N) → requires sqlite3_bind_pointer() to set the PTR parameter.
  • remember(V,PTR) → requires sqlite3_bind_pointer() to set the PTR parameter.
  • Enhancements to the command-line shell:
  • Add support for tab-completion using the COMPLETION extension, for both readline and linenoise.
  • Add the ".cd" command.
  • Enhance the ".schema" command to show the schema of all attached databases.
  • Enhance ".tables" so that it shows the schema names for all attached if the name is anything other than "main".
  • The ".import" command ignores an initial UTF-8 BOM.
  • Added the "--newlines" option to the ".dump" command to cause U+000a and U+000d characters to be output literally rather than escaped using the replace() function.
  • Query planner enhancements:
  • When generating individual loops for each ORed term of an OR scan, move any constant WHERE expressions outside of the loop, as is done for top-level loops.
  • The query planner examines the values of bound parameters to help determine if a partial index is usable.
  • When deciding between two plans with the same estimated cost, bias the selection toward the one that does not use the sorter.
  • Evaluate WHERE clause constraints involving correlated subqueries last, in the hope that they never have be evaluated at all.
  • Do not use the flattening optimization for a sub-query on the RHS of a LEFT JOIN if that subquery reads data from a virtual table as doing so prevents the query planner from creating automatic indexes on the results of the sub-query, which can slow down the query.
  • Bug Fixes:
  • Fix the behavior of sqlite3_column_name() for queries that use the flattening optimization so that the result is consistent with other queries that do not use that optimization, and with PostgreSQL, MySQL, and SQLServer. Ticket de3403bf5ae.
  • Fix the query planner so that it knows not to use automatic indexes on the right table of LEFT JOIN if the WHERE clause uses the IS operator. Fix for ce68383bf6aba.
  • Ensure that the query planner knows that any column of a flattened LEFT JOIN can be NULL even if that column is labeled with "NOT NULL". Fix for ticket 892fc34f173e99d8.
  • Fix rare false-positives in PRAGMA integrity_check when run on a database connection with attached databases. Ticket a4e06e75a9ab61a12
  • Fix a bug (discovered by OSSFuzz) that causes an assertion fault if certain dodgy CREATE TABLE declarations are used. Ticket bc115541132dad136

New in SQLite 3.19.3 (Jun 9, 2017)

  • Fix a bug associated with auto_vacuum that can lead to database corruption. The bug was introduced in version 3.16.0 (2017-01-02). Ticket fda22108.

New in SQLite 3.19.2 (May 26, 2017)

  • Fix more bugs in the LEFT JOIN flattening optimization. Ticket 7fde638e94287d2c.

New in SQLite 3.19.1 (May 24, 2017)

  • Fix a bug in the LEFT JOIN flattener optimization.
  • Remove a surplus semicolon that was causing problems for older versions of MSVC.

New in SQLite 3.19.0 (May 23, 2017)

  • The SQLITE_READ authorizer callback is invoked once with a column name that is an empty string for every table referenced in a query from which no columns are extracted.
  • When using an index on an expression, try to use expression values already available in the index, rather than loading the original columns and recomputing the expression.
  • Enhance the flattening optimization so that it is able to flatten views on the right-hand side of a LEFT JOIN.
  • Use replace() instead of char() for escaping newline and carriage-return characters embedded in strings in the .dump output from the command-line shell.
  • Avoid unnecessary foreign key processing in UPDATE statements that do not touch the columns that are constrained by the foreign keys.
  • On a DISTINCT query that uses an index, try to skip ahead to the next distinct entry using the index rather than stepping through rows, when an appropriate index is available.
  • Avoid unnecessary invalidation of sqlite3_blob handles when making changes to unrelated tables.
  • Transfer any terms of the HAVING clause that use only columns mentioned in the GROUP BY clause over to the WHERE clause for faster processing.
  • Reuse the same materialization of a VIEW if that VIEW appears more than once in the same query.
  • Enhance PRAGMA integrity_check so that it identifies tables that have two or more rows with the same rowid.
  • Enhance the FTS5 query syntax so that column filters may be applied to arbitrary expressions.
  • Enhance the json_extract() function to cache and reuse parses of JSON input text.
  • Added the anycollseq.c loadable extension that allows a generic SQLite database connection to read a schema that contains unknown and/or application-specific collating sequences.
  • Bug Fixes:
  • Fix a problem in REPLACE that can result in a corrupt database containing two or more rows with the same rowid. Fix for ticket f68dc596c4e6018d.
  • Fix a problem in PRAGMA integrity_check that was causing a subsequent VACUUM to behave suboptimally.
  • Fix the PRAGMA foreign_key_check command so that it works correctly with foreign keys on WITHOUT ROWID tables.
  • Disallow leading zeros in numeric constants in JSON. Fix for ticket b93be8729a895a528e2.
  • Disallow control characters inside of strings in JSON. Fix for ticket 6c9b5514077fed34551.
  • Limit the depth of recursion for JSON objects and arrays in order to avoid excess stack usage in the recursive descent parser. Fix for ticket 981329adeef51011052.

New in SQLite 3.18.0 (Mar 30, 2017)

  • Added the PRAGMA optimize command
  • The SQLite version identifier returned by the sqlite_source_id() SQL function and the sqlite3_sourceid() C API and found in the SQLITE_SOURCE_ID macro is now a 64-digit SHA3-256 hash instead of a 40-digit SHA1 hash.
  • Added the json_patch() SQL function to the JSON1 extension.
  • Enhance the LIKE optimization so that it works for arbitrary expressions on the left-hand side as long as the LIKE pattern on the right-hand side does not begin with a digit or minus sign.
  • Added the sqlite3_set_last_insert_rowid() interface and use the new interface in the FTS3, FTS4, and FTS5 extensions to ensure that the sqlite3_last_insert_rowid() interface always returns reasonable values.
  • Enhance PRAGMA integrity_check and PRAGMA quick_check so that they verify CHECK constraints.
  • Enhance the query plans for joins to detect empty tables early and halt without doing unnecessary work.
  • Enhance the sqlite3_mprintf() family of interfaces and the printf SQL function to put comma separators at the thousands marks for integers, if the "," format modifier is used in between the "%" and the "d" (example: "%,d").
  • Added the -DSQLITE_MAX_MEMORY=N compile-time option.
  • Added the .sha3sum dot-command and the .selftest dot-command to the command-line shell
  • Begin enforcing SQLITE_LIMIT_VDBE_OP. This can be used, for example, to prevent excessively large prepared statements in systems that accept SQL queries from untrusted users.
  • Various performance improvements.
  • Bug Fixes:
  • Ensure that indexed expressions with collating sequences are handled correctly. Fix for ticket eb703ba7b50c1a5.
  • Fix a bug in the 'start of ...' modifiers for the date and time functions. Ticket 6097cb92745327a1
  • Fix a potential segfault in complex recursive triggers, resulting from a bug in the OP_Once opcode introduced as part of a performance optimization in version 3.15.0. Ticket 06796225f59c057c
  • In the RBU extension, add extra sync operations to avoid the possibility of corruption following a power failure.
  • The sqlite3_trace_v2() output for nested SQL statements should always begin with a "--" comment marker.

New in SQLite 3.17.0 (Feb 14, 2017)

  • Add the SQLITE_DEFAULT_LOOKASIDE compile-time option.
  • Increase the default lookaside size from 512,125 to 1200,100 as this provides better performance while only adding 56KB of extra memory per connection. Memory-sensitive applications can restore the old default at compile-time, start-time, or run-time.
  • Use compiler built-ins __builtin_sub_overflow(), __builtin_add_overflow(), and __builtin_mul_overflow() when available. (All compiler built-ins can be omitted with the SQLITE_DISABLE_INTRINSIC compile-time option.)
  • Added the SQLITE_ENABLE_NULL_TRIM compile-time option, which can result in significantly smaller database files for some applications, at the risk of being incompatible with older versions of SQLite.
  • Change SQLITE_DEFAULT_PCACHE_INITSZ from 100 to 20, for improved performance.
  • Added the SQLITE_UINT64_TYPE compile-time option as an analog to SQLITE_INT64_TYPE.
  • Perform some UPDATE operations in a single pass instead of in two passes.
  • Enhance the session extension to support WITHOUT ROWID tables.
  • Fixed performance problems and potential stack overflows when creating views from multi-row VALUES clauses with hundreds of thousands of rows.
  • Added the sha1.c extension.
  • In the command-line shell, enhance the ".mode" command so that it restores the default column and row separators for modes "line", "list", "column", and "tcl".
  • Enhance the SQLITE_DIRECT_OVERFLOW_READ option so that it works in WAL mode as long as the pages being read are not in the WAL file.
  • Enhance the LEMON parser generator so that it can store the parser object as a stack variable rather than allocating space from the heap and make use of that enhancement in the amalgamation.
  • Other performance improvements. Uses about 6.5% fewer CPU cycles.
  • Approximately 25% better performance from the R-Tree extension:
  • Uses compiler built-ins (ex: __builtin_bswap32() or _byteswap_ulong()) for byteswapping when available.
  • Uses the sqlite3_blob key/value access object instead of SQL for pulling content out of R-Tree nodes
  • Other miscellaneous enhancements such as loop unrolling.
  • Bug Fixes:
  • Throw an error if the ON clause of a LEFT JOIN references tables to the right of the ON clause. This is the same behavior as PostgreSQL. Formerly, SQLite silently converted the LEFT JOIN into an INNER JOIN. Fix for ticket 25e335f802dd.
  • Use the correct affinity for columns of automatic indexes. Ticket 7ffd1ca1d2ad4ec.
  • Ensure that the sqlite3_blob_reopen() interface can correctly handle short rows. Fix for ticket e6e962d6b0f06f46e.

New in SQLite 3.16.2 (Jan 6, 2017)

  • Fix the REPLACE statement for WITHOUT ROWID tables that lack secondary indexes so that it works correctly with triggers and foreign keys. This was a new bug caused by performance optimizations added in version 3.16.0. Ticket 30027b613b4
  • Fix the sqlite3_value_text() interface so that it correctly translates content generated by zeroblob() into a string of all 0x00 characters. This is a long-standing issue discovered after the 3.16.1 release by OSS-Fuzz
  • Fix the bytecode generator to deal with a subquery in the FROM clause that is itself a UNION ALL where one side of the UNION ALL is a view that contains an ORDER BY. This is a long-standing issue that was discovered after the release of 3.16.1. See ticket 190c2507.
  • Adjust the sqlite3_column_count() API so it more often returns the same values for PRAGMA statements as it did in prior releases, to minimize disruption to applications that might be using that interface in unexpected ways.

New in SQLite 3.16.1 (Jan 4, 2017)

  • Fix a bug concerning the use of row values within triggers (see ticket 8c9458e7) that was in version 3.15.0 but was not reported until moments after the 3.16.0 release was published.

New in SQLite 3.16.0 (Jan 3, 2017)

  • Uses 9% fewer CPU cycles. (See the CPU performance measurement report for details on how the this performance increase was computed.)
  • Added experimental support for PRAGMA functions.
  • Added the SQLITE_DBCONFIG_NO_CKPT_ON_CLOSE option to sqlite3_db_config().
  • Enhance the date and time functions so that the 'unixepoch' modifier works for the full span of supported dates.
  • Changed the default configuration of the lookaside memory allocator from 500 slots of 128 bytes each into 125 slots of 512 bytes each.
  • Enhanced "WHERE x NOT NULL" partial indexes so that they are usable if the "x" column appears in a LIKE or GLOB operator.
  • Enhanced sqlite3_interrupt() so that it interrupts checkpoint operations that are in process.
  • Enhanced the LIKE and GLOB matching algorithm to be faster for cases when the pattern contains multiple wildcards.
  • Added the SQLITE_FCNTL_WIN32_GET_HANDLE file control opcode.
  • Added ".mode quote" to the command-line shell.
  • Added ".lint fkey-indexes" to the command-line shell.
  • Added the .imposter dot-command to the command-line shell.
  • Added the remember(V,PTR) SQL function as a loadable extension.
  • Rename the SQLITE_OMIT_BUILTIN_TEST compile-time option to SQLITE_UNTESTABLE to better reflect the implications of using it.
  • Bug Fixes:
  • Fix a long-standing bug in the query planner that caused incorrect results on a LEFT JOIN where the left-hand table is a subquery and the join constraint is a bare column name coming from the left-hand subquery. Ticket 2df0107b.
  • Correctly handle the integer literal -0x8000000000000000 in the query planner.

New in SQLite 3.15.2 (Nov 29, 2016)

  • Multiple bug fixes to the row value logic that was introduced in version 3.15.0.
  • Fix a NULL pointer dereference in ATTACH/DETACH following a maliciously constructed syntax error. Ticket 2f1b168ab4d4844.
  • Fix a crash that can occur following an out-of-memory condition in the built-in instr() function.
  • In the JSON extension, fix the JSON validator so that it correctly rejects invalid backslash escapes within strings.

New in SQLite 3.15.1 (Nov 4, 2016)

  • Added SQLITE_FCNTL_WIN32_GET_HANDLE file control opcode.
  • Bug Fixes:
  • Fix the VACUUM command so that it spills excess content to disk rather than holding everything in memory, and possible causing an out-of-memory error for larger database files. This fixes an issue introduced by version 3.15.0.
  • Fix a case (present since 3.8.0 - 2013-08-26) where OR-connected terms in the ON clause of a LEFT JOIN might cause incorrect results. Ticket 34a579141b2c5ac.
  • Fix a case where the use of row values in the ON clause of a LEFT JOIN might cause incorrect results. Ticket fef4bb4bd9185ec8f.

New in SQLite 3.15.0 (Oct 14, 2016)

  • CHANGES:
  • Added support for row values.
  • Allow deterministic SQL functions in the WHERE clause of a partial index.
  • Added the "modeof=filename" URI parameter on the unix VFS
  • Added support for SQLITE_DBCONFIG_MAINDBNAME.
  • Added the ability to VACUUM an ATTACH-ed database.
  • Enhance the fts5vocab virtual table to handle "ORDER BY term" efficiently.
  • Miscellaneous micro-optimizations reduce CPU usage by more than 7% on common workloads. Most optimization in this release has been on the front-end (sqlite3_prepare_v2()).
  • Enhancements to the command-line shell:
  • Add the ".testcase" and ".check" dot-commands.
  • Added the --new option to the ".open" dot-command, causing any prior content in the database to be purged prior to opening.
  • BUG FIXES:
  • The multiply operator now correctly detects 64-bit integer overflow and promotes to floating point in all corner-cases. Fix for ticket 1ec41379c9c1e400.
  • Correct handling of columns with redundant unique indexes when those columns are used on the LHS of an IN operator. Fix for ticket 0eab1ac759.
  • Skip NULL entries on range queries in indexes on expressions. Fix for ticket 4baa46491212947.
  • Ensure that the AUTOINCREMENT counters in the sqlite_sequence table are initialized doing "Xfer Optimization" on "INSERT ... SELECT" statements. Fix for ticket 7b3328086a5c116c.
  • Make sure the ORDER BY LIMIT optimization (from check-in 559733b09e) works with IN operators on INTEGER PRIMARY KEYs. Fix for ticket 96c1454c

New in SQLite 3.14.2 (Sep 12, 2016)

  • Improved support for using the STDCALL calling convention in winsqlite3.dll.
  • Fix the sqlite3_trace_v2() interface so that it is disabled if either the callback or the mask arguments are zero, in accordance with the documentation.
  • Fix commenting errors and improve the comments generated on EXPLAIN listings when the -DSQLITE_ENABLE_EXPLAIN_COMMENTS compile-time option is used.
  • Fix the ".read" command in the command-line shell so that it understands that its input is not interactive.
  • Correct affinity computations for a SELECT on the RHS of an IN operator. Fix for ticket 199df4168c.
  • The ORDER BY LIMIT optimization is not valid unless the inner-most IN operator loop is actually used by the query plan. Fix for ticket 0c4df46116e90f92.
  • Fix an internal code generator problem that was causing some DELETE operations to no-op. Ticket ef360601

New in SQLite 3.14.1 (Aug 12, 2016)

  • A performance enhancement to the page-cache "truncate" operation reduces COMMIT time by dozens of milliseconds on systems with a large page cache.
  • Fix to the --rbu option of sqldiff.

New in SQLite 3.14.0 (Aug 8, 2016)

  • Added support for WITHOUT ROWID virtual tables.
  • Improved the query planner so that the OR optimization can be used on virtual tables even if one or more of the disjuncts use the LIKE, GLOB, REGEXP, MATCH operators.
  • Added the CSV virtual table for reading RFC 4180 formatted comma-separated value files.
  • Added the carray() table-valued function extension.
  • Enabled persistent loadable extensions using the new SQLITE_OK_LOAD_PERMANENTLY return code from the extension entry point.
  • Added the SQLITE_DBSTATUS_CACHE_USED_SHARED option to sqlite3_db_status().
  • Add the vfsstat.c loadable extension - a VFS shim that measures I/O together with an eponymous virtual table that provides access to the measurements.
  • Improved algorithm for running queries with both an ORDER BY and a LIMIT where only the inner-most loop naturally generates rows in the correct order.
  • Enhancements to Lemon parser generator, so that it generates a faster parser.
  • The PRAGMA compile_options command now attempts to show the version number of the compiler that generated the library.
  • Enhance PRAGMA table_info so that it provides information about eponymous virtual tables.
  • Added the "win32-none" VFS, analogous to the "unix-none" VFS, that works like the default "win32" VFS except that it ignores all file locks.
  • The query planner uses a full scan of a partial index instead of a full scan of the main table, in cases where that makes sense.
  • Allow table-valued functions to appear on the right-hand side of an IN operator.
  • Created the dbhash.exe command-line utility.
  • Added two new C-language interfaces: sqlite3_expanded_sql() and sqlite3_trace_v2(). These new interfaces subsume the functions of sqlite3_trace() and sqlite3_profile() which are now deprecated.
  • Added the json_quote() SQL function to the json1 extension.
  • Disable the authorizer callback while reparsing the schema.
  • Added the SQLITE_ENABLE_UNKNOWN_SQL_FUNCTION compile-time option and turned that option on by default when building the command-line shell.
  • Bug Fixes:
  • Fix the ALTER TABLE command so that it does not corrupt descending indexes when adding a column to a legacy file format database. Ticket f68bf68513a1c15f
  • Fix a NULL-pointer dereference/crash that could occurs when a transitive WHERE clause references a non-existent collating sequence. Ticket e8d439c77685eca6.
  • Improved the cost estimation for an index scan which includes a WHERE clause that can be partially or fully evaluated using columns in the index and without having to do a table lookup. This fixes a performance regression that occurred for some obscure queries following the ORDER BY LIMIT optimization introduced in version 3.12.0.

New in SQLite 3.13.0 (May 18, 2016)

  • Postpone I/O associated with TEMP files for as long as possible, with the hope that the I/O can ultimately be avoided completely.
  • Merged the session extension into trunk.
  • Added the ".auth ON|OFF" command to the command-line shell.
  • Added the "--indent" option to the ".schema" and ".fullschema" commands of the command-line shell, to turn on pretty-printing.
  • Added the ".eqp full" option to the command-line shell, that does both EXPLAIN and EXPLAIN QUERY PLAN on each statement that is evaluated.
  • Improved unicode filename handling in the command-line shell on Windows.
  • Improved resistance against goofy query planner decisions caused by incomplete or incorrect modifications to the sqlite_stat1 table by the application.
  • Added the sqlite3_db_config(db,SQLITE_DBCONFIG_ENABLE_LOAD_EXTENSION) interface which allows the sqlite3_load_extension() C-API to be enabled while keeping the load_extension() SQL function disabled for security.
  • Change the temporary directory search algorithm on Unix to allow directories with write and execute permission, but without read permission, to serve as temporary directories. Apply this same standard to the "." fallback directory.
  • Bug Fixes:
  • Fix a problem with the multi-row one-pass DELETE optimization that was causing it to compute incorrect answers with a self-referential subquery in the WHERE clause. Fix for ticket dc6ebeda9396087
  • Fix a possible segfault with DELETE when table is a rowid table with an INTEGER PRIMARY KEY and the WHERE clause contains a OR and the table has one or more indexes that are able to trigger the OR optimization, but none of the indexes reference any table columns other than the INTEGER PRIMARY KEY. Ticket 16c9801ceba49.
  • When checking for the WHERE-clause push-down optimization, verify that all terms of the compound inner SELECT are non-aggregate, not just the last term. Fix for ticket f7f8c97e97597.
  • Fix a locking race condition in Windows that can occur when two or more processes attempt to recover the same hot journal at the same time.

New in SQLite 3.12.2 (Apr 18, 2016)

  • Fix a backwards compatibility problem in version 3.12.0 and 3.12.1: Columns declared as "INTEGER" PRIMARY KEY (with quotes around the datatype keyword) where not being recognized as an INTEGER PRIMARY KEY, which resulted in an incompatible database file. Ticket 7d7525cb01b68
  • Fix a bug (present since version 3.9.0) that can cause the DELETE operation to miss rows if PRAGMA reverse_unordered_selects is turned on. Ticket a306e56ff68b8fa5
  • Fix a bug in the code generator that can causes incorrect results if two or more virtual tables are joined and the virtual table used in outer loop of the join has an IN operator constraint.
  • Correctly interpret negative "PRAGMA cache_size" values when determining the cache size used for sorting large amounts of data.

New in SQLite 3.12.1 (Apr 8, 2016)

  • Fix a boundary condition error introduced by version 3.12.0 that can result in a crash during heavy SAVEPOINT usage. Ticket 7f7f8026eda38.
  • Fix views so that they inherit column datatypes from the table that they are defined against, when possible.
  • Fix the query planner so that IS and IS NULL operators are able to drive an index on a LEFT OUTER JOIN.

New in SQLite 3.12.0 (Mar 29, 2016)

  • Potentially Disruptive Change:
  • The SQLITE_DEFAULT_PAGE_SIZE is increased from 1024 to 4096. The SQLITE_DEFAULT_CACHE_SIZE is changed from 2000 to -2000 so the same amount of cache memory is used by default. See the application note on the version 3.12.0 page size change for further information.
  • Performance enhancements:
  • Enhancements to the Lemon parser generator so that it creates a smaller and faster SQL parser.
  • Only create master journal files if two or more attached databases are all modified, do not have PRAGMA synchronous set to OFF, and do not have the journal_mode set to OFF, MEMORY, or WAL.
  • Only create statement journal files when their size exceeds a threshold. Otherwise the journal is held in memory and no I/O occurs. The threshold can be configured at compile-time using SQLITE_STMTJRNL_SPILL or at start-time using sqlite3_config(SQLITE_CONFIG_STMTJRNL_SPILL).
  • The query planner is able to optimize IN operators on virtual tables even if the xBestIndex method does not set the sqlite3_index_constraint_usage.omit flag of the virtual table column to the left of the IN operator.
  • The query planner now does a better job of optimizing virtual table accesses in a 3-way or higher join where constraints on the virtual table are split across two or more other tables of the join.
  • More efficient handling of application-defined SQL functions, especially in cases where the application defines hundreds or thousands of custom functions.
  • The query planner considers the LIMIT clause when estimating the cost of ORDER BY.
  • The configure script (on unix) automatically detects pread() and pwrite() and sets compile-time options to use those OS interfaces if they are available.
  • Reduce the amount of memory needed to hold the schema.
  • Other miscellaneous micro-optimizations for improved performance and reduced memory usage.
  • New Features:
  • Added the SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER option to sqlite3_db_config() which allows the two-argument version of the fts3_tokenizer() SQL function to be enabled or disabled at run-time.
  • Added the sqlite3rbu_bp_progress() interface to the RBU extension.
  • The PRAGMA defer_foreign_keys=ON statement now also disables RESTRICT actions on foreign key.
  • Added the sqlite3_system_errno() interface.
  • Added the SQLITE_DEFAULT_SYNCHRONOUS and SQLITE_DEFAULT_WAL_SYNCHRONOUS compile-time options. The SQLITE_DEFAULT_SYNCHRONOUS compile-time option replaces the SQLITE_EXTRA_DURABLE option, which is no longer supported.
  • Enhanced the ".stats" command in the command-line shell to show more information about I/O performance obtained from /proc, when available.
  • Bug fixes:
  • Make sure the sqlite3_set_auxdata() values from multiple triggers within a single statement do not interfere with one another. Ticket dc9b1c91.
  • Fix the code generator for expressions of the form "x IN (SELECT...)" where the SELECT statement on the RHS is a correlated subquery. Ticket 5e3c886796e5512e.
  • Fix a harmless TSAN warning associated with the sqlite3_db_readonly() interface.

New in SQLite 3.11.1 (Mar 3, 2016)

  • Improvements to the Makefiles and build scripts used by VisualStudio.
  • Fix an FTS5 issue in which the 'optimize' command could cause index corruption.
  • Fix a buffer overread that might occur if FTS5 is used to query a corrupt database file.
  • Increase the maximum "scope" value for the spellfix1 extension from 6 to 30.

New in SQLite 3.11.0 (Feb 15, 2016)

  • General improvements:
  • Enhanced WAL mode so that it works efficiently with transactions that are larger than the cache_size.
  • Added the FTS5 detail option.
  • Added the "EXTRA" option to PRAGMA synchronous that does a sync of the containing directory when a rollback journal is unlinked in DELETE mode, for better durability. The SQLITE_EXTRA_DURABLE compile-time option enables PRAGMA synchronous=EXTRA by default.
  • Enhanced the query planner so that it is able to use a covering index as part of the OR optimization.
  • Avoid recomputing NOT NULL and CHECK constraints on unchanged columns in UPDATE statement.
  • Many micro-optimizations, resulting in a library that is faster than the previous release.
  • Enhancements to the command-line shell:
  • By default, the shell is now in "auto-explain" mode. The output of EXPLAIN commands is automatically formatted.
  • Added the ".vfslist" dot-command.
  • The SQLITE_ENABLE_EXPLAIN_COMMENTS compile-time option is now turned on by default in the standard builds.
  • Enhancements to the TCL Interface:
  • If a database connection is opened with the "-uri 1" option, then URI filenames are honored by the "backup" and "restore" commands.
  • Added the "-sourceid" option to the "sqlite3" command.
  • Makefile improvements:
  • Improved pthreads detection in configure scripts.
  • Add the ability to do MSVC Windows builds from the amalgamation tarball.
  • Bug fixes:
  • Fix an issue with incorrect sharing of VDBE temporary registers between co-routines that could cause incorrect query results in obscure cases. Ticket d06a25c84454a.
  • Fix a problem in the sqlite3_result_subtype() interface that could cause problems for the json1 extension under obscure circumstances. Fix for ticket f45ac567eaa9f9.
  • Escape control characters in JSON strings. Fix for ticket ad2559db380abf8.
  • Reenable the xCurrentTime and xGetLastError methods in the built-in unix VFSes as long as SQLITE_OMIT_DEPRECATED is not defined.
  • Backwards Compatibility:
  • Because of continuing security concerns, the two-argument version of of the seldom-used and little-known fts3_tokenizer() function is disabled unless SQLite is compiled with the SQLITE_ENABLE_FTS3_TOKENIZER.

New in SQLite 3.10.2 (Jan 20, 2016)

  • Critical bug fix:
  • Version 3.10.0 introduced a case-folding bug in the LIKE operator which is fixed by this patch release. Ticket 80369eddd5c94.
  • Other miscellaneous bug fixes:
  • Fix a use-after-free that can occur when SQLite is compiled with -DSQLITE_HAS_CODEC.
  • Fix the build so that it works with -DSQLITE_OMIT_WAL.
  • Fix the configure script for the amalgamation so that the --readline option works again on Raspberry PIs.
  • Hashes:
  • SQLITE_SOURCE_ID: "2016-01-20 15:27:19 17efb4209f97fb4971656086b138599a91a75ff9"
  • SHA1 for sqlite3.c: f7088b19d97cd7a1c805ee95c696abd54f01de4f

New in SQLite 3.10.1 (Jan 14, 2016)

  • New feature:
  • Add the SQLITE_FCNTL_JOURNAL_POINTER file control.
  • Bug fix:
  • Fix a 16-month-old bug in the query planner that could generate incorrect results when a scalar subquery attempts to use the block sorting optimization.

New in SQLite 3.10.0 (Jan 6, 2016)

  • General improvements:
  • Added support for LIKE, GLOB, and REGEXP operators on virtual tables.
  • Added the colUsed field to sqlite3_index_info for use by the sqlite3_module.xBestIndex method.
  • Enhance the PRAGMA cache_spill statement to accept a 32-bit integer parameter which is the threshold below which cache spilling is prohibited.
  • On unix, if a symlink to a database file is opened, then the corresponding journal files are based on the actual filename, not the symlink name.
  • Added the "--transaction" option to sqldiff.
  • Added the sqlite3_db_cacheflush() interface.
  • Added the sqlite3_strlike() interface.
  • When using memory-mapped I/O map the database file read-only so that stray pointers and/or array overruns in the application cannot accidently modify the database file.
  • Added the experimental sqlite3_snapshot_get(), sqlite3_snapshot_open(), and sqlite3_snapshot_free() interfaces. These are subject to change or removal in a subsequent release.
  • Enhance the 'utc' modifier in the date and time functions so that it is a no-op if the date/time is known to already be in UTC. (This is not a compatibility break since the behavior has long been documented as "undefined" in that case.)
  • Added the json_group_array() and json_group_object() SQL functions in the json extension.
  • Added the SQLITE_LIKE_DOESNT_MATCH_BLOBS compile-time option.
  • Many small performance optimizations.
  • Portability enhancements:
  • Work around a sign-exension bug in the optimizer of the HP C compiler on HP/UX. (details)
  • Enhancements to the command-line shell:
  • Added the ".changes ON|OFF" and ".vfsinfo" dot-commands.
  • Translate between MBCS and UTF8 when running in cmd.exe on Windows.
  • Enhancements to makefiles:
  • Added the --enable-editline and --enable-static-shell options to the various autoconf-generated configure scripts.
  • Omit all use of "awk" in the makefiles, to make building easier for MSVC users.
  • Important fixes:
  • Fix inconsistent integer to floating-point comparison operations that could result in a corrupt index if the index is created on a table column that contains both large integers and floating point values of similar magnitude. Ticket 38a97a87a6.
  • Fix an infinite-loop in the query planner that could occur on malformed common table expressions.
  • Various bug fixes in the sqldiff tool.

New in SQLite 3.9.2 (Nov 2, 2015)

  • Fix the schema parser so that it interprets certain (obscure and ill-formed) CREATE TABLE statements the same as legacy. Fix for ticket ac661962a2aeab3c331
  • Fix a query planner problem that could result in an incorrect answer due to the use of automatic indexing in subqueries in the FROM clause of a correlated scalar subqueries. Fix for ticket 8a2adec1.

New in SQLite 3.9.1 (Oct 16, 2015)

  • Fix the json1 extension so that it does not recognize ASCII form-feed as a whitespace character, in order to comply with RFC-7159. Fix for ticket 57eec374ae1d0a1d
  • Add a few #ifdef and build script changes to address compilation issues that appeared after the 3.9.0 release.

New in SQLite 3.9.0 (Oct 14, 2015)

  • Policy Changes:
  • The version numbering conventions for SQLite are revised to use the emerging standard of semantic versioning.
  • New Features And Enhancements:
  • Added the json1 extension module in the source tree, and in the amalgamation. Enable support using the SQLITE_ENABLE_JSON1 compile-time option.
  • Added Full Text Search version 5 (FTS5) to the amalgamation, enabled using SQLITE_ENABLE_FTS5. FTS5 will be considered "experimental" (subject to incompatible changes) for at least one more release cycle.
  • The CREATE VIEW statement now accepts an optional list of column names following the view name.
  • Added support for indexes on expressions.
  • Added support for table-valued functions in the FROM clause of a SELECT statement.
  • Added support for eponymous virtual tables.
  • A VIEW may now reference undefined tables and functions when initially created. Missing tables and functions are reported when the VIEW is used in a query.
  • Added the sqlite3_value_subtype() and sqlite3_result_subtype() interfaced (used by the json1 extension).
  • The query planner is now able to use partial indexes that contain AND-connected terms in the WHERE clause.
  • The sqlite3_analyzer.exe utility is updated to report the depth of each btree and to show the average fanout for indexes and WITHOUT ROWID tables.
  • Enhanced the dbstat virtual table so that it can be used as a table-valued function where the argument is the schema to be analyzed.
  • Other changes:
  • The sqlite3_memory_alarm() interface, which has been deprecated and undocumented for 8 years, is changed into a no-op.
  • Important fixes:
  • Fixed a critical bug in the SQLite Encryption Extension that could cause the database to become unreadable and unrecoverable if a VACUUM command changed the size of the encryption nonce.
  • Added a memory barrier in the implementation of sqlite3_initialize() to help ensure that it is thread-safe.
  • Fix the OR optimization so that it always ignores subplans that do not use an index.
  • Do not apply the WHERE-clause pushdown optimization on terms that originate in the ON or USING clause of a LEFT JOIN. Fix for ticket c2a19d81652f40568c.

New in SQLite 3.8.11.1 (Jul 30, 2015)

  • Restore an undocumented side-effect of PRAGMA cache_size: force the database schema to be parsed if the database has not been previously accessed.
  • Fix a long-standing problem in sqlite3_changes() for WITHOUT ROWID tables that was reported a few hours after the 3.8.11 release.

New in SQLite 3.8.11 (Jul 28, 2015)

  • Added the experimental RBU extension. Note that this extension is experimental and subject to change in incompatible ways.
  • Added the experimental FTS5 extension. Note that this extension is experimental and subject to change in incompatible ways.
  • Added the sqlite3_value_dup() and sqlite3_value_free() interfaces.
  • Enhance the spellfix1 extension to support ON CONFLICT clauses.
  • The IS operator is now able to drive indexes.
  • Enhance the query planner to permit automatic indexing on FROM-clause subqueries that are implemented by co-routine.
  • Disallow the use of "rowid" in common table expressions.
  • Added the PRAGMA cell_size_check command for better and earlier detection of database file corruption.
  • Added the matchinfo 'b' flag to the matchinfo() function in FTS3.
  • Improved fuzz-testing of database files, with fixes for problems found.
  • Add the fuzzcheck test program and automatically run this program using both SQL and database test cases on "make test".
  • Added the SQLITE_MUTEX_STATIC_VFS1 static mutex and use it in the Windows VFS.
  • The sqlite3_profile() callback is invoked (by sqlite3_reset() or sqlite3_finalize()) for statements that did not run to completion.
  • Enhance the page cache so that it can preallocate a block of memory to use for the initial set page cache lines. Set the default preallocation to 100 pages. Yields about a 5% performance increase on common workloads.
  • Miscellaneous micro-optimizations result in 22.3% more work for the same number of CPU cycles relative to the previous release. SQLite now runs twice as fast as version 3.8.0 and three times as fast as version 3.3.9. (Measured using cachegrind on the speedtest1.c workload on Ubuntu 14.04 x64 with gcc 4.8.2 and -Os. Your performance may vary.)
  • Added the sqlite3_result_zeroblob64() and sqlite3_bind_zeroblob64() interfaces.
  • Important bug fixes:
  • Fix CREATE TABLE AS so that columns of type TEXT never end up holding an INT value. Ticket f2ad7de056ab1dc9200
  • Fix CREATE TABLE AS so that it does not leave NULL entries in the sqlite_master table if the SELECT statement on the right-hand side aborts with an error. Ticket 873cae2b6e25b
  • Fix the skip-scan optimization so that it works correctly when the OR optimization is used on WITHOUT ROWID tables. Ticket 8fd39115d8f46
  • Fix the sqlite3_memory_used() and sqlite3_memory_highwater() interfaces so that they actually do provide a 64-bit answer.

New in SQLite 3.8.10.2 (May 21, 2015)

  • Index corruption after a sequence of valid SQL statements!
  • It has been many years since anything like this bug has snuck into an official SQLite release. But for the pasts seven months (version 3.8.7 through version 3.8.10.1) if you do an INSERT into a carefully crafted schema in which there are two nested triggers that convert an index key value from TEXT to INTEGER and then back to TEXT again, the INTEGER value might get inserted as the index key instead of the correct TEXT, resulting in index corruption. This patch release adds a single line of code to fix the problem.
  • If you do actually encounter this problem, running REINDEX on the damaged indexes will clear it.

New in SQLite 3.8.10.1 (May 11, 2015)

  • Make sqlite3_compileoption_used() responsive to the SQLITE_ENABLE_DBSTAT_VTAB compile-time option.
  • Fix a harmless warning in the command-line shell on some versions of MSVC.
  • Fix minor issues with the dbstat virtual table.

New in SQLite 3.8.10 (May 8, 2015)

  • Added the sqldiff.exe utility program for computing the differences between two SQLite database files.
  • Added the y format string to the matchinfo() function of FTS3.
  • Performance improvements for ORDER BY, VACUUM, CREATE INDEX, PRAGMA integrity_check, and PRAGMA quick_check.
  • Fix many obscure problems discovered while SQL fuzzing.
  • Identify all methods for important objects in the interface documentation. (example)
  • Made the American Fuzzy Lop fuzzer a standard part of SQLite's testing strategy.
  • Add the ".binary" and ".limits" commands to the command-line shell.
  • Make the "dbstat" virtual table part of standard builds when compiled with the SQLITE_ENABLE_DBSTAT_VTAB option.
  • SQLITE_SOURCE_ID: "2015-05-07 11:53:08 cf975957b9ae671f34bb65f049acf351e650d437"
  • SHA1 for sqlite3.c: 0b34f0de356a3f21b9dfc761f3b7821b6353c570

New in SQLite 3.8.9 (Apr 9, 2015)

  • Add VxWorks-7 as an officially supported and tested platform.
  • Added the sqlite3_status64() interface.
  • Fix memory size tracking so that it works even if SQLite uses more than 2GiB of memory.
  • Added the PRAGMA index_xinfo command.
  • Fix a potential 32-bit integer overflow problem in the sqlite3_blob_read() and sqlite3_blob_write() interfaces.
  • Ensure that prepared statements automatically reset on extended error codes of SQLITE_BUSY and SQLITE_LOCKED even when compiled using SQLITE_OMIT_AUTORESET.
  • Correct miscounts in the sqlite3_analyzer.exe utility related to WITHOUT ROWID tables.
  • Added the ".dbinfo" command to the command-line shell.
  • Improve the performance of fts3/4 queries that use the OR operator and at least one auxiliary fts function.
  • Fix a bug in the fts3 snippet() function causing it to omit leading separator characters from snippets that begin with the first token in a column.

New in SQLite 3.8.8.3 (Feb 26, 2015)

  • The 3.8.8.3 patch release fixes an obscure problem in the SQLite code generator that can cause incorrect results when the qualifying expression of a partial index is used inside the ON clause of a LEFT JOIN. This problem has been in the code since support for partial indexes was first added in version 3.8.0. However, it is difficult to imagine a valid reason to every put the qualifying constraint inside the ON clause of a LEFT JOIN, and so this issue has never come up before.
  • Any applications that are vulnerable to this bug would have encountered problems already. Hence, upgrading from the previous release is optional.

New in SQLite 3.8.8.2 (Jan 30, 2015)

  • Enhance sqlite3_wal_checkpoint_v2(TRUNCATE) interface so that it truncates the WAL file even if there is no checkpoint work to be done.

New in SQLite 3.8.8.1 (Jan 21, 2015)

  • Fix a bug in the sorting logic, present since version 3.8.4, that can cause output to appear in the wrong order on queries that contains an ORDER BY clause, a LIMIT clause, and that have approximately 60 or more columns in the result set.

New in SQLite 3.8.8 (Jan 17, 2015)

  • New Features:
  • Added the PRAGMA data_version command that can be used to determine if a database file has been modified by another process.
  • Added the SQLITE_CHECKPOINT_TRUNCATE option to the sqlite3_wal_checkpoint_v2() interface, with corresponding enhancements to PRAGMA wal_checkpoint.
  • Added the sqlite3_stmt_scanstatus() interface, available only when compiled with SQLITE_ENABLE_STMT_SCANSTATUS.
  • The sqlite3_table_column_metadata() is enhanced to work correctly on WITHOUT ROWID tables and to check for the existence of a a table if the column name parameter is NULL. The interface is now also included in the build by default, without requiring the SQLITE_ENABLE_COLUMN_METADATA compile-time option.
  • Added the SQLITE_ENABLE_API_ARMOR compile-time option.
  • Added the SQLITE_REVERSE_UNORDERED_SELECTS compile-time option.
  • Added the SQLITE_SORTER_PMASZ compile-time option and SQLITE_CONFIG_PMASZ start-time option.
  • Added the SQLITE_CONFIG_PCACHE_HDRSZ option to sqlite3_config() which makes it easier for applications to determine the appropriate amount of memory for use with SQLITE_CONFIG_PAGECACHE.
  • The number of rows in a VALUES clause is no longer limited by SQLITE_LIMIT_COMPOUND_SELECT.
  • Added the eval.c loadable extension that implements an eval() SQL function that will recursively evaluate SQL.
  • Performance Enhancements:
  • Reduce the number of memcpy() operations involved in balancing a b-tree, for 3.2% overall performance boost.
  • Improvements to cost estimates for the skip-scan optimization.
  • The automatic indexing optimization is now capable of generating a partial index if that is appropriate.
  • Bug fixes:
  • Ensure durability following a power loss with "PRAGMA journal_mode=TRUNCATE" by calling fsync() right after truncating the journal file.
  • The query planner now recognizes that any column in the right-hand table of a LEFT JOIN can be NULL, even if that column has a NOT NULL constraint. Avoid trying to optimize out NULL tests in those cases. Fix for ticket 6f2222d550f5b0ee7ed.
  • Make sure ORDER BY puts rows in ascending order even if the DISTINCT operator is implemented using a descending index. Fix for ticket c5ea805691bfc4204b1cb9e.
  • Fix data races that might occur under stress when running with many threads in shared cache mode where some of the threads are opening and closing connections.
  • Fix obscure crash bugs found by american fuzzy lop. Ticket a59ae93ee990a55.
  • Work around a GCC optimizer bug (for gcc 4.2.1 on MacOS 10.7) that caused the R-Tree extension to compute incorrect results when compiled with -O3.
  • Other changes:
  • Disable the use of the strchrnul() C-library routine unless it is specifically enabled using the -DHAVE_STRCHRNULL compile-time option.
  • Improvements to the effectiveness and accuracy of the likelihood(), likely(), and unlikely() SQL hint functions.

New in SQLite 3.8.7.4 (Dec 9, 2014)

  • Bug fix: Add in a mutex that was omitted from the previous release.

New in SQLite 3.8.7.3 (Dec 8, 2014)

  • Bug fix: Ensure the cached KeyInfo objects (an internal abstraction not visible to the application) do not go stale when operating in shared cache mode and frequently closing and reopening some database connections while leaving other database connections on the same shared cache open continuously.
  • Bug fix: Recognize that any column in the right-hand table of a LEFT JOIN can be NULL even if the column has a NOT NULL constraint. Do not apply optimizations that assume the column is never NULL.

New in SQLite 3.8.7.2 (Nov 26, 2014)

  • Enhance the ROLLBACK command so that pending queries are allowed to continue as long as the schema is unchanged. Formerly, a ROLLBACK would cause all pending queries to fail with an SQLITE_ABORT or SQLITE_ABORT_ROLLBACK error. That error is still returned if the ROLLBACK modifies the schema.
  • Bug fix: Make sure that NULL results from OP_Column are fully and completely NULL and do not have the MEM_Ephem bit set. Ticket 094d39a4c95ee4.
  • Bug fix: The %c format in sqlite3_mprintf() is able to handle precisions greater than 70.
  • Bug fix: Do not automatically remove the DISTINCT keyword from a SELECT that forms the right-hand side of an IN operator since it is necessary if the SELECT also contains a LIMIT. Ticket db87229497.
  • SQLITE_SOURCE_ID: "2014-11-18 20:57:56 2ab564bf9655b7c7b97ab85cafc8a48329b27f93"
  • SHA1 for sqlite3.c: b2a68d5783f48dba6a8cb50d8bf69b238c5ec53a

New in SQLite 3.8.7 (Oct 18, 2014)

  • Performance Enhancements:
  • Many micro-optimizations result in 20.3% more work for the same number of CPU cycles relative to the previous release. The cumulative performance increase since version 3.8.0 is 61%. (Measured using cachegrind on the speedtest1.c workload on Ubuntu 13.10 x64 with gcc 4.8.1 and -Os. Your performance may vary.)
  • The sorter can use auxiliary helper threads to increase real-time response. This feature is off by default and may be enabled using the PRAGMA threads command or the SQLITE_DEFAULT_WORKER_THREADS compile-time option.
  • Enhance the skip-scan optimization so that it is able to skip index terms that occur in the middle of the index, not just as the left-hand side of the index.
  • Improved optimization of CAST operators.
  • Various improvements in how the query planner uses sqlite_stat4 information to estimate plan costs.
  • New Features:
  • Added new interfaces with 64-bit length parameters: sqlite3_malloc64(), sqlite3_realloc64(), sqlite3_bind_blob64(), sqlite3_result_blob64(), sqlite3_bind_text64(), and sqlite3_result_text64().
  • Added the new interface sqlite3_msize() that returns the size of a memory allocation obtained from sqlite3_malloc64() and its variants.
  • Added the SQLITE_LIMIT_WORKER_THREADS option to sqlite3_limit() and PRAGMA threads command for configuring the number of available worker threads.
  • The spellfix1 extension allows the application to optionally specify the rowid for each INSERT.
  • Added the User Authentication extension.
  • Bug Fixes:
  • Fix a bug in the partial index implementation that might result in an incorrect answer if a partial index is used in a subquery or in a view. Ticket 98d973b8f5.
  • Fix a query planner bug that might cause a table to be scanned in the wrong direction (thus reversing the order of output) when a DESC index is used to implement the ORDER BY clause on a query that has an identical GROUP BY clause. Ticket ba7cbfaedc7e6.
  • Fix a bug in sqlite3_trace() that was causing it to sometimes fail to print an SQL statement if that statement needed to be re-prepared. Ticket 11d5aa455e0d98f3c1e6a08
  • Fix a faulty assert() statement. Ticket 369d57fb8e5ccdff06f1
  • Test, Debug, and Analysis Changes:
  • Show ASCII-art abstract syntax tree diagrams using the ".selecttrace" and ".wheretrace" commands in the command-line shell when compiled with SQLITE_DEBUG, SQLITE_ENABLE_SELECTTRACE, and SQLITE_ENABLE_WHERETRACE. Also provide the sqlite3TreeViewExpr() and sqlite3TreeViewSelect() entry points that can be invoked from with the debugger to show the parse tree when stopped at a breakpoint.
  • Drop support for SQLITE_ENABLE_TREE_EXPLAIN. The SELECTTRACE mechanism provides more useful diagnostics information.
  • New options to the command-line shell for configuring auxiliary memory usage: --pagecache, --lookaside, and --scratch.

New in SQLite 3.8.6 (Aug 16, 2014)

  • Added support for hexadecimal integer literals in the SQL parser. (Ex: 0x123abc)
  • Enhanced the PRAGMA integrity_check command to detect UNIQUE and NOT NULL constraint violations.
  • Increase the maximum value of SQLITE_MAX_ATTACHED from 62 to 125.
  • Increase the timeout in WAL mode before issuing an SQLITE_PROTOCOL error from 1 second to 10 seconds.
  • Added the likely(X) SQL function.
  • The unicode61 tokenizer is now included in FTS4 by default.
  • Trigger automatic reprepares on all prepared statements when ANALYZE is run.
  • Added a new loadable extension source code file to the source tree: fileio.c
  • Add extension functions readfile(X) and writefile(X,Y) (using code copy/pasted from fileio.c in the previous bullet) to the command-line shell.
  • Added the .fullschema dot-command to the command-line shell.
  • Performance Enhancements:
  • Deactivate the DISTINCT keyword on subqueries on the right-hand side of the IN operator.
  • Add the capability of evaluating an IN operator as a sequence of comparisons as an alternative to using a table lookup. Use the sequence of comparisons implementation in circumstances where it is likely to be faster, such as when the right-hand side of the IN operator is small and/or changes frequently.
  • The query planner now uses sqlite_stat4 information (created by ANALYZE) to help determine if the skip-scan optimization is appropriate.
  • Ensure that the query planner never tries to use a self-made transient index in place of a schema-defined index.
  • Other minor tweaks to improve the quality of VDBE code.
  • Bug Fixes:
  • Fix a bug in CREATE UNIQUE INDEX, introduced when WITHOUT ROWID support added in version 3.8.2, that allows a non-unique NOT NULL column to be given a UNIQUE index. Ticket 9a6daf340df99ba93c
  • Fix a bug in R-Tree extension, introduced in the previous release, that can cause an incorrect results for queries that use the rowid of the R-Tree on the left-hand side of an IN operator. Ticket d2889096e7bdeac6.
  • Fix the sqlite3_stmt_busy() interface so that it gives the correct answer for ROLLBACK statements that have been stepped but never reset.
  • Fix a bug in that would cause a null pointer to be dereferenced if a column with a DEFAULT that is an aggregate function tried to usee its DEFAULT. Ticket 3a88d85f36704eebe1
  • CSV output from the command-line shell now always uses CRNL for the row separator and avoids inserting CR in front of NLs contained in data.
  • Fix a column affinity problem with the IN operator. Ticket 9a8b09f8e6.
  • Fix the ANALYZE command so that it adds correct samples for WITHOUT ROWID tables in the sqlite_stat4 table. Ticket b2fa5424e6fcb15.
  • SQLITE_SOURCE_ID: "2014-08-15 11:46:33 9491ba7d738528f168657adb43a198238abde19e"
  • SHA1 for sqlite3.c: 72c64f05cd9babb9c0f9b3c82536d83be7804b1c

New in SQLite 3.8.5 (Jun 5, 2014)

  • Added support for partial sorting by index.
  • Enhance the query planner so that it always prefers an index that uses a superset of WHERE clause terms relative to some other index.
  • Improvements to the automerge command of FTS4 to better control the index size for a full-text index that is subject to a large number of updates.
  • Added the sqlite3_rtree_query_callback() interface to R-Tree extension
  • Added new URI query parameters "nolock" and "immutable".
  • Use less memory by not remembering CHECK constraints on read-only database connections.
  • Enable the OR optimization for WITHOUT ROWID tables.
  • Render expressions of the form "x IN (?)" (with a single value in the list on the right-hand side of the IN operator) as if they where "x==?", Similarly optimize "x NOT IN (?)"
  • Add the ".system" and ".once" commands to the command-line shell.
  • Added the SQLITE_IOCAP_IMMUTABLE bit to the set of bits that can be returned by the xDeviceCharacteristics method of a VFS.
  • Added the SQLITE_TESTCTRL_BYTEORDER test control.
  • Bug Fixes:
  • OFFSET clause ignored on queries without a FROM clause. Ticket 07d6a0453d
  • Assertion fault on queries involving expressions of the form "x IN (?)". Ticket e39d032577.
  • Incorrect column datatype reported. Ticket a8a0d2996a
  • Duplicate row returned on a query against a table with more than 16 indices, each on a separate column, and all used via OR-connected constraints. Ticket 10fb063b11
  • Partial index causes assertion fault on UPDATE OR REPLACE. Ticket 2ea3e9fe63
  • Crash when calling undocumented SQL function sqlite_rename_parent() with NULL parameters. Ticket 264b970c43
  • ORDER BY ignored if the query has an identical GROUP BY. Ticket b75a9ca6b0
  • The group_concat(x,'') SQL function returns NULL instead of an empty string when all inputs are empty strings. Ticket 55746f9e65
  • Fix a bug in the VDBE code generator that caused crashes when doing an INSERT INTO ... SELECT statement where the number of columns being inserted is larger than the number of columns in the destination table. Ticket e9654505cfd
  • Fix a problem in CSV import in the command-line shell where if the leftmost field of the first row in the CSV file was both zero bytes in size and unquoted no data would be imported.
  • Fix a problem in FTS4 where the left-most column that contained the notindexed column name as a prefix was not indexed rather than the column whose name matched exactly.
  • Fix the sqlite3_db_readonly() interface so that it returns true if the database is read-only due to the file format write version number being too large.
  • SQLITE_SOURCE_ID: "2014-06-04 14:06:34 b1ed4f2a34ba66c29b130f8d13e9092758019212"
  • SHA1 for sqlite3.c: 7bc194957238c61b1a47f301270286be5bc5208c

New in SQLite 3.8.4.3 (Apr 4, 2014)

  • Add a one-character fix for a problem that might cause incorrect query results on a query that mixes DISTINCT, GROUP BY in a subquery, and ORDER BY.

New in SQLite 3.8.4.2 (Mar 27, 2014)

  • Fix a potential buffer overread that could result when trying to search a corrupt database file.

New in SQLite 3.8.4.1 (Mar 12, 2014)

  • Work around a C-preprocessor macro conflict that breaks the build for some configurations with Microsoft Visual Studio.
  • When computing the cost of the skip-scan optimization, take into account the fact that multiple seeks are required.

New in SQLite 3.8.4 (Mar 10, 2014)

  • Code optimization and refactoring for improved performance.
  • Add the ".clone" and ".save" commands to the command-line shell.
  • Update the banner on the command-line shell to alert novice users when they are using an ephemeral in-memory database.
  • Fix editline support in the command-line shell.
  • Add support for coverage testing of VDBE programs using the SQLITE_TESTCTRL_VDBE_COVERAGE verb of sqlite3_test_control().
  • Update the _FILE_OFFSET_BITS macro so that builds work again on QNX.
  • Change the datatype of SrcList.nSrc from type u8 to type int to work around an issue in the C compiler on AIX.
  • Get extension loading working on Cygwin.
  • Bug fix: Fix the char() SQL function so that it returns an empty string rather than an "out of memory" error when called with zero arguments.
  • Bug fix: DISTINCT now recognizes that a zeroblob and a blob of all 0x00 bytes are the same thing. Ticket [fccbde530a]
  • Bug fix: Compute the correct answer for queries that contain an IS NOT NULL term in the WHERE clause and also contain an OR term in the WHERE clause and are compiled with SQLITE_ENABLE_STAT4. Ticket [4c86b126f2]
  • Bug fix: Make sure "rowid" columns are correctly resolved in joins between normal tables and WITHOUT ROWID tables. Ticket [c34d0557f7]
  • Bug fix: Make sure the same temporary registers are not used in concurrent co-routines used to implement compound SELECT statements containing ORDER BY clauses, as such use can lead to incorrect answers. Ticket [8c63ff0eca]
  • Bug fix: Ensure that "ORDER BY random()" clauses do not get optimized out. Ticket [65bdeb9739]
  • Bug fix: Repair a name-resolution error that can occur in sub-select statements contained within a TRIGGER. Ticket [4ef7e3cfca]
  • Bug fix: Fix column default values expressions of the form "DEFAULT(-(-9223372036854775808))" so that they work correctly, initializing the column to a floating point value approximately equal to +9223372036854775808.0.

New in SQLite 3.8.3.1 (Feb 12, 2014)

  • Fix a bug (ticket 4c86b126f2) that causes rows to go missing on some queries with OR clauses and IS NOT NULL operators in the WHERE clause, when the SQLITE_ENABLE_STAT3 or SQLITE_ENABLE_STAT4 compile-time options are used.
  • Fix a harmless compiler warning that was causing problems for VS2013.
  • SQLITE_SOURCE_ID: "2014-02-11 14:52:19 ea3317a4803d71d88183b29f1d3086f46d68a00e"
  • SHA1 for sqlite3.c: 990004ef2d0eec6a339e4caa562423897fe02bf0

New in SQLite 3.8.3 (Feb 4, 2014)

  • Added support for common table expressions and the WITH clause.
  • Added the printf() SQL function.
  • Added SQLITE_DETERMINISTIC as an optional bit in the 4th argument to the sqlite3_create_function() and related interfaces, providing applications with the ability to create new functions that can be factored out of inner loops when they have constant arguments.
  • Add SQLITE_READONLY_DBMOVED error code, returned at the beginning of a transaction, to indicate that the underlying database file has been renamed or moved out from under SQLite.
  • Allow arbitrary expressions, including function calls and subqueries, in the filename argument to ATTACH.
  • Allow a VALUES clause to be used anywhere a SELECT statement is valid.
  • Reseed the PRNG used by sqlite3_randomness(N,P) when invoked with N==0. Automatically reseed after a fork() on unix.
  • Enhance the spellfix1 virtual table so that it can search efficiently by rowid.
  • Performance enhancements.
  • Improvements to the comments in the VDBE byte-code display when running EXPLAIN.
  • Add the "%token_class" directive to LEMON parser generator and use it to simplify the grammar.
  • Change the LEMON source code to avoid calling C-library functions that OpenBSD considers dangerous. (Ex: sprintf).
  • Bug fix: In the command-line shell CSV import feature, do not end a field when an escaped double-quote occurs at the end of a CRLN line.
  • SQLITE_SOURCE_ID: "2014-02-03 13:52:03 e816dd924619db5f766de6df74ea2194f3e3b538"
  • SHA1 for sqlite3.c: 98a07da78f71b0275e8d9c510486877adc31dbee

New in SQLite 3.8.2 (Feb 4, 2014)

  • Added support for common table expressions and the WITH clause.
  • Added the printf() SQL function.
  • Added SQLITE_DETERMINISTIC as an optional bit in the 4th argument to the sqlite3_create_function() and related interfaces, providing applications with the ability to create new functions that can be factored out of inner loops when they have constant arguments.
  • Add SQLITE_READONLY_DBMOVED error code, returned at the beginning of a transaction, to indicate that the underlying database file has been renamed or moved out from under SQLite.
  • Allow arbitrary expressions, including function calls and subqueries, in the filename argument to ATTACH.
  • Allow a VALUES clause to be used anywhere a SELECT statement is valid.
  • Reseed the PRNG used by sqlite3_randomness(N,P) when invoked with N==0. Automatically reseed after a fork() on unix.
  • Enhance the spellfix1 virtual table so that it can search efficiently by rowid.
  • Performance enhancements.
  • Improvements to the comments in the VDBE byte-code display when running EXPLAIN.
  • Add the "%token_class" directive to LEMON parser generator and use it to simplify the grammar.
  • Change the LEMON source code to avoid calling C-library functions that OpenBSD considers dangerous. (Ex: sprintf).
  • Bug fix: In the command-line shell CSV import feature, do not end a field when an escaped double-quote occurs at the end of a CRLN line.
  • SQLITE_SOURCE_ID: "2014-02-03 13:52:03 e816dd924619db5f766de6df74ea2194f3e3b538"
  • SHA1 for sqlite3.c: 98a07da78f71b0275e8d9c510486877adc31dbee

New in SQLite 3.8.2 (Dec 7, 2013)

  • Changed the defined behavior for the CAST expression when floating point values greater than +9223372036854775807 are cast into into integers so that the result is the largest possible integer, +9223372036854775807, instead of the smallest possible integer, -9223372036854775808. After this change, CAST(9223372036854775809.0 as INT) yields +9223372036854775807 instead of -9223372036854775808. ← Potentially Incompatible Change!
  • Added support for WITHOUT ROWID tables.
  • Added the skip-scan optimization to the query planner.
  • Extended the virtual table interface, and in particular the sqlite3_index_info object to allow a virtual table to report its estimate on the number of rows that will be returned by a query.
  • Update the R-Tree extension to make use of the enhanced virtual table interface.
  • Add the SQLITE_ENABLE_EXPLAIN_COMMENTS compile-time option.
  • Enhanced the comments that are inserted into EXPLAIN output when the SQLITE_ENABLE_EXPLAIN_COMMENTS compile-time option is enabled.
  • Performance enhancements in the VDBE, especially to the OP_Column opcode.
  • Factor constant subexpressions in inner loops out to the initialization code in prepared statements.
  • Enhanced the ".explain" output formatting of the command-line shell so that loops are indented to better show the structure of the program.
  • Enhanced the ".timer" feature of the command-line shell so that it shows wall-clock time in addition to system and user times.
  • SQLITE_SOURCE_ID: "2013-12-06 14:53:30 27392118af4c38c5203a04b8013e1afdb1cebd0d"
  • SHA1 for sqlite3.c: 6422c7d69866f5ea3db0968f67ee596e7114544e

New in SQLite 3.8.1 (Oct 18, 2013)

  • Added the unlikely() and likelihood() SQL functions to be used as hints to the query planner.
  • Enhancements to the query planner:
  • Take into account the fact WHERE clause terms that cannot be used with indices still probably reduce the number of output rows.
  • Estimate the sizes of table and index rows and use the smallest applicable B-Tree for full scans and "count(*)" operations.
  • Added the soft_heap_limit pragma.
  • Added support for SQLITE_ENABLE_STAT4
  • Added support for "sz=NNN" parameters at the end of sqlite_stat1.stat fields used to specify the average length in bytes for table and index rows.
  • Avoid running foreign-key constraint checks on an UPDATE if none of the modified columns are associated with foreign keys.
  • Added the SQLITE_MINIMUM_FILE_DESCRIPTOR compile-time option
  • Added the win32-longpath VFS on windows, permitting filenames up to 32K characters in length.
  • The Date And Time Functions are enhanced so that the current time (ex: julianday('now')) is always the same for multiple function invocations within the same sqlite3_step() call.
  • Add the "totype.c" extension, implementing the tointeger() and toreal() SQL functions.
  • FTS4 queries are better able to make use of docid

New in SQLite 3.8.0.2 (Sep 4, 2013)

  • Add support for partial indexes
  • Cut-over to the next generation query planner for faster and better query plans.
  • The EXPLAIN QUERY PLAN output no longer shows an estimate of the number of rows generated by each loop in a join.
  • Added the FTS4 notindexed option, allowing non-indexed columns in an FTS4 table.
  • Added the SQLITE_STMTSTATUS_VM_STEP option to sqlite3_stmt_status().
  • Added the cache_spill pragma.
  • Added the query_only pragma.
  • Added the defer_foreign_keys pragma and the sqlite3_db_status(db, SQLITE_DBSTATUS_DEFERRED_FKS,...) C-language interface.
  • Added the "percentile()" function as a loadable extension in the ext/misc subdirectory of the source tree.
  • Added the SQLITE_ALLOW_URI_AUTHORITY compile-time option.
  • Add the sqlite3_cancel_auto_extension(X) interface.
  • A running SELECT statement that lacks a FROM clause (or any other statement that never reads or writes from any database file) will not prevent a read transaction from closing.
  • Add the SQLITE_DEFAULT_AUTOMATIC_INDEX compile-time option. Setting this option to 0 disables automatic indices by default.
  • Issue an SQLITE_WARNING_AUTOINDEX warning on the SQLITE_CONFIG_LOG whenever the query planner uses an automatic index.
  • Added the SQLITE_FTS3_MAX_EXPR_DEPTH compile-time option.
  • Added an optional 5th parameter defining the collating sequence to the next_char() extension SQL function.
  • The SQLITE_BUSY_SNAPSHOT extended error code is returned in WAL mode when a read transaction cannot be upgraded to a write transaction because the read is on an older snapshot.
  • Enhancements to the sqlite3_analyzer utility program to provide size information separately for each individual index of a table, in addition to the aggregate size.
  • Allow read transactions to be freely opened and closed by SQL statements run from within the implementation of application-defined SQL functions if the function is called by a SELECT statement that does not access any database table.
  • Disable the use of posix_fallocate() on all (unix) systems unless the HAVE_POSIX_FALLOCATE compile-time option is used.
  • Update the ".import" command in the command-line shell to support multi-line fields and correct RFC-4180 quoting and to issue warning and/or error messages if the input text is not strictly RFC-4180 compliant.
  • Bug fix: In the unicode61 tokenizer of FTS4, treat all private code points as identifier symbols.
  • Bug fix: Bare identifiers in ORDER BY clauses bind more tightly to output column names, but identifiers in expressions bind more tightly to input column names. Identifiers in GROUP BY clauses always prefer output column names, however.
  • Bug fixes: Multiple problems in the legacy query optimizer were fixed by the move to NGQP.
  • Fix an off-by-one error that caused quoted empty string at the end of a CRNL-terminated line of CSV input to be misread by the command-line shell.
  • Fix a query planner bug involving a LEFT JOIN with a BETWEEN or LIKE/GLOB constraint and then another INNER JOIN to the right that involves an OR constraint.
  • Fix a query planner bug that could result in a segfault when querying tables with a UNIQUE or PRIMARY KEY constraint with more than four columns.

New in SQLite 3.8.0.1 (Aug 30, 2013)

  • Fix an off-by-one error that caused quoted empty string at the end of a CRNL-terminated line of CSV input to be misread by the command-line shell.
  • Fix a query planner bug involving a LEFT JOIN with a BETWEEN or LIKE/GLOB constraint and then another INNER JOIN to the right that involves an OR constraint.
  • Fix a query planner bug that could result in a segfault when querying tables with a UNIQUE or PRIMARY KEY constraint with more than four columns.

New in SQLite 3.8.0 (Aug 27, 2013)

  • Add support for partial indexes
  • Cut-over to the next generation query planner for faster and better query plans.
  • The EXPLAIN QUERY PLAN output no longer shows an estimate of the number of rows generated by each loop in a join.
  • Added the FTS4 notindexed option, allowing non-indexed columns in an FTS4 table.
  • Added the SQLITE_STMTSTATUS_VM_STEP option to sqlite3_stmt_status().
  • Added the cache_spill pragma.
  • Added the query_only pragma.
  • Added the defer_foreign_keys pragma and the sqlite3_db_status(db, SQLITE_DBSTATUS_DEFERRED_FKS,...) C-language interface.
  • Added the "percentile()" function as a loadable extension in the ext/misc subdirectory of the source tree.
  • Added the SQLITE_ALLOW_URI_AUTHORITY compile-time option.
  • Add the sqlite3_cancel_auto_extension(X) interface.
  • A running SELECT statement that lacks a FROM clause (or any other statement that never reads or writes from any database file) will not prevent a read transaction from closing.
  • Add the SQLITE_DEFAULT_AUTOMATIC_INDEX compile-time option. Setting this option to 0 disables automatic indices by default.
  • Issue an SQLITE_WARNING_AUTOINDEX warning on the SQLITE_CONFIG_LOG whenever the query planner uses an automatic index.
  • Added the SQLITE_FTS3_MAX_EXPR_DEPTH compile-time option.
  • Added an optional 5th parameter defining the collating sequence to the next_char() extension SQL function.
  • The SQLITE_BUSY_SNAPSHOT extended error code is returned in WAL mode when a read transaction cannot be upgraded to a write transaction because the read is on an older snapshot.
  • Enhancements to the sqlite3_analyzer utility program to provide size information separately for each individual index of a table, in addition to the aggregate size.
  • Allow read transactions to be freely opened and closed by SQL statements run from within the implementation of application-defined SQL functions if the function is called by a SELECT statement that does not access any database table.
  • Disable the use of posix_fallocate() on all (unix) systems unless the HAVE_POSIX_FALLOCATE compile-time option is used.
  • Update the ".import" command in the command-line shell to support multi-line fields and correct RFC-4180 quoting and to issue warning and/or error messages if the input text is not strictly RFC-4180 compliant.
  • Bug fix: In the unicode61 tokenizer of FTS4, treat all private code points as identifier symbols.
  • Bug fix: Bare identifiers in ORDER BY clauses bind more tightly to output column names, but identifiers in expressions bind more tightly to input column names. Identifiers in GROUP BY clauses always prefer output column names, however.
  • Bug fixes: Multiple problems in the legacy query optimizer were fixed by the move to NGQP.

New in SQLite 3.7.17 (May 20, 2013)

  • Add support for memory-mapped I/O.
  • Add the sqlite3_strglob() convenience interface.
  • Assigned the integer at offset 68 in the database header as the Application ID for when SQLite is used as an application file-format. Added the PRAGMA application_id command to query and set the Application ID.
  • Report rollback recovery in the error log as SQLITE_NOTICE_RECOVER_ROLLBACK. Change the error log code for WAL recover from SQLITE_OK to SQLITE_NOTICE_RECOVER_WAL.
  • Report the risky uses of unlinked database files and database filename aliasing as SQLITE_WARNING messages in the error log.
  • Added the SQLITE_TRACE_SIZE_LIMIT compile-time option.
  • Increase the default value of SQLITE_MAX_SCHEMA_RETRY to 50 and make sure that it is honored in every place that a schema change might force a statement retry.
  • Add a new test harness called "mptester" used to verify correct operation when multiple processes are using the same database file at the same time.
  • Enhance the extension loading mechanism to be more flexible (while still maintaining backwards compatibility) in two ways:
  • If the default entry point "sqlite3_extension_init" is not present in the loadable extension, also try an entry point "sqlite3_X_init" where "X" is based on the shared library filename. This allows every extension to have a different entry point, which allows them to be statically linked with no code changes.
  • The shared library filename passed to sqlite3_load_extension() may omit the filename suffix, and an appropriate architecture-dependent suffix (".so", ".dylib", or ".dll") will be added automatically.
  • Added many new loadable extensions to the source tree, including amatch, closure, fuzzer, ieee754, nextchar, regexp, spellfix, and wholenumber. See header comments on each extension source file for further information about what that extension does.
  • Enhance FTS3 to avoid using excess stack space when there are a huge number of terms on the right-hand side of the MATCH operator. A side-effect of this change is that the MATCH operator can only accommodate 12 NEAR operators at a time.
  • Enhance the fts4aux virtual table so that it can be a TEMP table.
  • Added the fts3tokenize virtual table to the full-text search logic.
  • Query planner enhancement: Use the transitive property of constraints to move constraints into the outer loops of a join whenever possible, thereby reducing the amount of work that needs to occur in inner loops.
  • Discontinue the use of posix_fallocate() on unix, as it does not work on all filesystems.
  • Improved tracing and debugging facilities in the Windows VFS.
  • Bug fix: Fix a potential database corruption bug in shared cache mode when one database connection is closed while another is in the middle of a write transaction. Ticket e636a050b7
  • Bug fix: Only consider AS names from the result set as candidates for resolving identifiers in the WHERE clause if there are no other matches. In the ORDER BY clause, AS names take priority over any column names. Ticket 2500cdb9be05
  • Bug fix: Do not allow a virtual table to cancel the ORDER BY clause unless all outer loops are guaranteed to return no more than one row result. Ticket ba82a4a41eac1.
  • Bug fix: Do not suppress the ORDER BY clause on a virtual table query if an IN constraint is used. Ticket f69b96e3076e.
  • Bug fix: The command-line shell gives an exit code of 0 when terminated using the ".quit" command.
  • Bug fix: Make sure PRAGMA statements appear in sqlite3_trace() output.
  • Bug fix: When a compound query that uses an ORDER BY clause with a COLLATE operator, make sure that the sorting occurs according to the specified collation and that the comparisons associate with the compound query use the native collation. Ticket 6709574d2a8d8.
  • Bug fix: Makes sure the authorizer callback gets a valid pointer to the string "ROWID" for the column-name parameter when doing an UPDATE that changes the rowid. Ticket 0eb70d77cb05bb2272
  • Bug fix: Do not move WHERE clause terms inside OR expressions that are contained within an ON clause of a LEFT JOIN. Ticket f2369304e4
  • Bug fix: Make sure an error is always reported when attempting to preform an operation that requires a collating sequence that is missing. Ticket 0fc59f908b

New in SQLite 3.7.16.2 (Apr 12, 2013)

  • Fix a bug (present since version 3.7.13) that could result in database corruption on windows if two or more processes try to access the same database file at the same time and immediately after third process crashed in the middle of committing to that same file. See ticket 7ff3120e4f for further information.

New in SQLite 3.7.16.1 (Mar 29, 2013)

  • Fix for a bug in the ORDER BY optimizer that was introduced in version 3.7.15 which would sometimes optimize out the sorting step when in fact the sort was required. Ticket a179fe7465
  • Fix a long-standing bug in the CAST expression that would recognize UTF16 characters as digits even if their most-significant-byte was not zero. Ticket 689137afb6da41.
  • Fix a bug in the NEAR operator of FTS3 when applied to subfields. Ticket 38b1ae018f.
  • Fix a long-standing bug in the storage engine that would (very rarely) cause a spurious report of an SQLITE_CORRUPT error but which was otherwise harmless. Ticket 6bfb98dfc0c.
  • The SQLITE_OMIT_MERGE_SORT option has been removed. The merge sorter is now a required component of SQLite.
  • Fixed lots of spelling errors in the source-code comments

New in SQLite 3.7.16 (Mar 18, 2013)

  • Added the PRAGMA foreign_key_check command.
  • Added new extended error codes for all SQLITE_CONSTRAINT errors
  • Added the SQLITE_READONLY_ROLLBACK extended error code for when a database cannot be opened because it needs rollback recovery but is read-only.
  • Added SQL functions unicode(A) and char(X1,...,XN).
  • Performance improvements for PRAGMA incremental_vacuum, especially in cases where the number of free pages is greater than what will fit on a single trunk page of the freelist.
  • Improved optimization of queries containing aggregate min() or max().
  • Enhance virtual tables so that they can potentially use an index when the WHERE clause contains the IN operator.
  • Allow indices to be used for sorting even if prior terms of the index are constrained by IN operators in the WHERE clause.
  • Enhance the PRAGMA table_info command so that the "pk" column is an increasing integer to show the order of columns in the primary key.
  • Enhance the query optimizer to exploit transitive join constraints.
  • Performance improvements in the query optimizer.
  • Allow the error message from PRAGMA integrity_check to be longer than 20000 bytes.
  • Improved name resolution for deeply nested queries.
  • Added the test_regexp.c module as a demonstration of how to implement the REGEXP operator.
  • Improved error messages in the RTREE extension.
  • Enhance the command-line shell so that a non-zero argument to the ".exit" command causes the shell to exit immediately without cleanly shutting down the database connection.
  • Improved error messages for invalid boolean arguments to dot-commands in the command-line shell.
  • Improved error messages for "foreign key mismatch" showing the names of the two tables involved.
  • Remove all uses of umask() in the unix VFS.
  • Added the PRAGMA vdbe_addoptrace and PRAGMA vdbe_debug commands.
  • Change to use strncmp() or the equivalent instead of memcmp() when comparing non-zero-terminated strings.
  • Update cygwin interfaces to omit deprecated API calls.
  • Enhance the spellfix1 extension so that the edit distance cost table can be changed at runtime by inserting a string like 'edit_cost_table=TABLE' into the "command" field.
  • Bug fix: repair a long-standing problem that could cause incorrect query results in a 3-way or larger join that compared INTEGER fields against TEXT fields in two or more places. Ticket fc7bd6358f
  • Bug fix: Issue an error message if the 16-bit reference counter on a view overflows due to an overly complex query.
  • Bug fix: Avoid leaking memory on LIMIT and OFFSET clauses in deeply nested UNION ALL queries.
  • Bug fix: Make sure the schema is up-to-date prior to running pragmas table_info, index_list, index_info, and foreign_key_list.
  • SQLITE_SOURCE_ID: "2013-03-18 11:39:23 66d5f2b76750f3520eb7a495f6247206758f5b90"
  • SHA1 for sqlite3.c: 7308ab891ca1b2ebc596025cfe4dc36f1ee89cf6

New in SQLite 3.7.15.2 (Jan 9, 2013)

  • Fix a bug, introduced in version 3.7.15, that causes an ORDER BY clause to be optimized out of a three-way join when the ORDER BY is actually required.

New in SQLite 3.7.15.1 (Dec 20, 2012)

  • SQLite version 3.7.15.1 is a patch release that fixes a single bug that was introduced in version version 3.7.15. The fix involved changing two lines of code and adding a single assert(). This release also includes some new test cases to prevent a regression of the bug, and the version number is increased, of course.

New in SQLite 3.7.13 (Jun 12, 2012)

  • In-memory databases that are specified using URI filenames are allowed to use shared cache, so that the same in-memory database can be accessed from multiple database connections.
  • Recognize and use the mode=memory query parameter in URI filenames.
  • Avoid resetting the schema of shared cache connections when any one connection closes. Instead, wait for the last connection to close before reseting the schema.
  • In the RTREE extension, when rounding 64-bit floating point numbers to 32-bit for storage, always round in a direction that causes the bounding box to get larger.
  • Adjust the unix driver to avoid unnecessary calls to fchown().
  • Add interfaces sqlite3_quota_ferror() and sqlite3_quota_file_available() to the test_quota.c module.
  • The sqlite3_create_module() and sqlite3_create_module_v2() interfaces return SQLITE_MISUSE on any attempt to overload or replace a virtual table module. The destructor is always called in this case, in accordance with historical and current documentation.
  • SQLITE_SOURCE_ID: "2012-06-11 02:05:22 f5b5a13f7394dc143aa136f1d4faba6839eaa6dc"
  • SHA1 for sqlite3.c: ff0a771d6252545740ba9685e312b0e3bb6a641b

New in SQLite 3.7.11 (Mar 21, 2012)

  • Enhance the INSERT syntax to allow multiple rows to be inserted via the VALUES clause.
  • Enhance the CREATE VIRTUAL TABLE command to support the IF NOT EXISTS clause.
  • Added the sqlite3_stricmp() interface as a counterpart to sqlite3_strnicmp().
  • Added the sqlite3_db_readonly() interface.
  • Added the SQLITE_FCNTL_PRAGMA file control, giving VFS implementations the ability to add new PRAGMA statements or to override built-in PRAGMAs.
  • Queries of the form: "SELECT max(x), y FROM table" returns the value of y on the same row that contains the maximum x value.
  • Added support for the FTS4 languageid option.
  • Documented support for the FTS4 content option. This feature has actually been in the code since version 3.7.9 but is only now considered to be officially supported.
  • Pending statements no longer block ROLLBACK. Instead, the pending statement will return SQLITE_ABORT upon next access after the ROLLBACK.
  • Improvements to the handling of CSV inputs in the command-line shell
  • Fix a bug introduced in version 3.7.10 that might cause a LEFT JOIN to be incorrectly converted into an INNER JOIN if the WHERE clause indexable terms connected by OR.

New in SQLite 3.7.8 (Sep 20, 2011)

  • Orders of magnitude performance improvement for CREATE INDEX on very large tables.
  • Improved the windows VFS to better defend against interference from anti-virus software.
  • Improved query plan optimization when the DISTINCT keyword is present.
  • Allow more system calls to be overridden in the unix VFS - to provide better support for chromium sandboxes.
  • Increase the default size of a lookahead cache line from 100 to 128 bytes.
  • Enhancements to the test_quota.c module so that it can track preexisting files.
  • Bug fix: Virtual tables now handle IS NOT NULL constraints correctly.
  • Bug fixes: Correctly handle nested correlated subqueries used with indices in a WHERE clause.

New in SQLite 3.7.7 (Jun 25, 2011)

  • Add support for URI filenames
  • Add the sqlite3_vtab_config() interface in support of ON CONFLICT clauses with virtual tables.
  • Add the xSavepoint, xRelease and xRollbackTo methods in virtual tables in support of SAVEPOINT for virtual tables.
  • Update the built-in FTS3/FTS4 and RTREE virtual tables to support ON CONFLICT clauses and REPLACE.
  • Avoid unnecessary reparsing of the database schema.
  • Added support for the FTS4 prefix option and the FTS4 order option.
  • Allow WAL-mode databases to be opened read-only as long as there is an existing read/write connection.
  • Added support for short filenames.
  • SQLITE_SOURCE_ID: "2011-06-23 19:49:22 4374b7e83ea0a3fbc3691f9c0c936272862f32f2"
  • SHA1 for sqlite3.c: 5bbe79e206ae5ffeeca760dbd0d66862228db551

New in SQLite 3.7.6.3 (May 19, 2011)

  • Fix a problem with WAL mode which could cause transactions to silently rollback if the cache_size is set very small (less than 10) and SQLite comes under memory pressure.

New in SQLite 3.7.6 (Apr 12, 2011)

  • Added the sqlite3_wal_checkpoint_v2() interface and enhanced the wal_checkpoint pragma to support blocking checkpoints.
  • Improvements to the query planner so that it makes better estimates of plan costs and hence does a better job of choosing the right plan, especially when SQLITE_ENABLE_STAT2 is used.
  • Fix a bug which prevented deferred foreign key constraints from being enforced when sqlite3_finalize() was not called by one statement with a failed foreign key constraint prior to another statement with foreign key constraints running.
  • Integer arithmetic operations that would have resulted in overflow are now performed using floating-point instead.
  • Increased the version number on the VFS object to 3 and added new methods xSetSysCall, xGetSysCall, and xNextSysCall used for doing full-coverage testing.
  • Increase the maximum value of SQLITE_MAX_ATTACHED from 30 to 62 (though the default value remains at 10).
  • Enhancements to FTS4:
  • Added the fts4aux table
  • Added support for compressed FTS4 content
  • Enhance the ANALYZE command to support the name of an index as its argument, in order to analyze just that one index.
  • Added the "unix-excl" built-in VFS on unix and unix-like platforms.
  • SQLITE_SOURCE_ID: "2011-04-12 01:58:40 f9d43fa363d54beab6f45db005abac0a7c0c47a7"
  • SHA1 for sqlite3.c: f38df08547efae0ff4343da607b723f588bbd66b

New in SQLite 3.7.5 (Feb 1, 2011)

  • Added the sqlite3_vsnprintf() interface.
  • Added the SQLITE_DBSTATUS_LOOKASIDE_HIT, SQLITE_DBSTATUS_LOOKASIDE_MISS_SIZE, and SQLITE_DBSTATUS_LOOKASIDE_MISS_FULL options for the sqlite3_db_status() interface.
  • Added the SQLITE_OMIT_AUTORESET compile-time option.
  • Added the SQLITE_DEFAULT_FOREIGN_KEYS compile-time option.
  • Updates to sqlite3_stmt_readonly() so that its result is well-defined for all prepared statements and so that it works with VACUUM.
  • Added the "-heap" option to the command-line shell
  • Fix a bug involving frequent changes in and out of WAL mode and VACUUM that could (in theory) cause database corruption.
  • Enhance the sqlite3_trace() mechanism so that nested SQL statements such as might be generated by virtual tables are shown but are shown in comments and without parameter expansion. This greatly improves tracing output when using the FTS3/4 and/or RTREE virtual tables.
  • Change the xFileControl() methods on all built-in VFSes to return SQLITE_NOTFOUND instead of SQLITE_ERROR for an unrecognized operation code.
  • The SQLite core invokes the SQLITE_FCNTL_SYNC_OMITTED file control to the VFS in place of a call to xSync if the database has PRAGMA synchronous set to OFF.

New in SQLite 3.7.4 (Dec 8, 2010)

  • Added the sqlite3_blob_reopen() interface to allow an existing sqlite3_blob object to be rebound to a new row.
  • Use the new sqlite3_blob_reopen() interface to improve the performance of FTS.
  • VFSes that do not support shared memory are allowed to access WAL databases if PRAGMA locking_mode is set to EXCLUSIVE.
  • Enhancements to EXPLAIN QUERY PLAN.
  • Added the sqlite3_stmt_readonly() interface.
  • Added PRAGMA checkpoint_fullfsync.
  • Added the SQLITE_FCNTL_FILE_POINTER option to sqlite3_file_control().
  • Added support for FTS4 and enhancements to the FTS matchinfo() function.
  • Added the test_superlock.c module which provides example code for obtaining an exclusive lock to a rollback or WAL database.
  • Added the test_multiplex.c module which provides an example VFS that provides multiplexing (sharding) of a DB, splitting it over multiple files of fixed size.
  • A very obscure bug associated with the or optimization was fixed.

New in SQLite 3.7.3 (Oct 19, 2010)

  • This release adds two new interfaces (really just variations on existing interfaces). The sqlite3_create_function_v2() interface adds a destructor for the application-data pointer. The new sqlite3_soft_heap_limit64() interface allows the soft heap limit to be set to a value greater than 231.
  • The RTREE extension has been enhanced with the ability to have an application-defined query region. This might be used, for example, to locate all objects within the field of view of a camera.
  • The 3.7.3 release also includes some performance enhancements, including query planner improvements, documentation updates, and fixes to some very obscure bugs.

New in SQLite 3.7.2 (Aug 24, 2010)

  • Fix an old and very obscure bug that can lead to corruption of the database free-page list when incremental_vacuum is used.

New in SQLite 3.7.0 (Jul 22, 2010)

  • Added support for write-ahead logging.
  • Query planner enhancement - automatic transient indices are created when doing so reduces the estimated query time.
  • Query planner enhancement - the ORDER BY becomes a no-op if the query also contains a GROUP BY clause that forces the correct output order.
  • Add the SQLITE_DBSTATUS_CACHE_USED verb for sqlite3_db_status().
  • The logical database size is now stored in the database header so that bytes can be appended to the end of the database file without corrupting it and so that SQLite will work correctly on systems that lack support for ftruncate().

New in SQLite 3.6.23.1 (Apr 16, 2010)

  • Added the secure_delete pragma.
  • Added the sqlite3_compileoption_used() and sqlite3_compileoption_get() interfaces as well as the compile_options pragma and the sqlite_compileoption_used() and sqlite_compileoption_get() SQL functions.
  • Added the sqlite3_log() interface together with the SQLITE_CONFIG_LOG verb to sqlite3_config(). The ".log" command is added to the Command Line Interface.
  • Improvements to FTS3.
  • Improvements and bug-fixes in support for SQLITE_OMIT_FLOATING_POINT.
  • The integrity_check pragma is enhanced to detect out-of-order rowids.
  • The ".genfkey" operator has been removed from the Command Line Interface.
  • Updates to the co-hosted Lemon LALR(1) parser generator. (These updates did not affect SQLite.)
  • Various minor bug fixes and performance enhancements.

New in SQLite 3.6.22 (Feb 4, 2010)

  • Fix bugs that can (rarely) lead to incorrect query results when the CAST or OR operators are used in the WHERE clause of a query.
  • Continuing enhancements and improvements to FTS3.
  • Other miscellanous bug fixes.

New in SQLite 3.6.21 (Dec 8, 2009)

  • The SQL output resulting from sqlite3_trace() is now modified to include the values of bound parameters.
  • Performance optimizations targetting a specific use case from a single high-profile user of SQLite. A 12% reduction in the number of CPU operations is achieved (as measured by valgrind). Actual performance improvements in practice may vary depending on workload. Changes include:
  • The ifnull() and coalesce() SQL functions are now implemented using in-line VDBE code rather than calling external functions, so that unused arguments need never be evaluated.
  • The substr() SQL function does not bother to measure the length its entire input string if it is only computing a prefix
  • Unnecessary OP_IsNull, OP_Affinity, and OP_MustBeInt VDBE opcodes are suppressed
  • Various code refactorizations for performance
  • The FTS3 extension has undergone a major rework and cleanup. New FTS3 documentation is now available.
  • The SQLITE_SECURE_DELETE compile-time option fixed to make sure that content is deleted even when the truncate optimization applies.
  • Improvements to "dot-command" handling in the Command Line Interface.
  • Other minor bug fixes and documentation enhancements.