CINXE.COM

<!DOCTYPE html> <html> <head> <meta charset="UTF-8"> <meta name=viewport content="width=device-width, initial-scale=1"> <title>Blog - Apache Drill</title> <link href="https://maxcdn.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css" rel="stylesheet" type="text/css"/> <link href="/css/site.css" rel="stylesheet" type="text/css"/> <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"/> <link rel="icon" href="/favicon.ico" type="image/x-icon"/> <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/1.11.1/jquery.min.js" language="javascript" type="text/javascript"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery-easing/1.3/jquery.easing.min.js" language="javascript" type="text/javascript"></script> <script language="javascript" type="text/javascript" src="/js/modernizr.custom.js"></script> <script language="javascript" type="text/javascript" src="/js/script.js"></script> <script language="javascript" type="text/javascript" src="/js/drill.js"></script> </head> <body onResize="resized();"> <div class="page-wrap"> <div class="bui"></div> <div id="menu" class="mw"> <ul> <li class='toc-categories'> <a class="expand-toc-icon" href="javascript:void(0);"></a> </li> <li class="logo"><a href="/"></a></li> <li class='expand-menu'> <a href="javascript:void(0);">Menu</a> </li> <li class="clear-float"></li> <li class="nav"> <a>Language</a> <ul> <li> <a style="font-weight: bold;" href="/blog/" >en</a> </li> <li> <a href="/zh/blog/" >zh</a> </li> </ul> </li> <li class="apache-link"> <a href="/apacheASF/">Apache</a> </li> <li class="poweredby"> <a href="/poweredBy">Powered By</a> </li> <li class="documentation-menu"> <a href="/docs/">Documentation</a> <ul> <li><a href="/docs/getting-started/">Getting Started</a></li> <li><a href="/docs/architecture/">Architecture</a></li> <li><a href="/docs/tutorials/">Tutorials</a></li> <li><a href="/docs/drill-on-yarn/">Drill-on-YARN</a></li> <li><a href="/docs/install-drill/">Install Drill</a></li> <li><a href="/docs/configure-drill/">Configure Drill</a></li> <li><a href="/docs/connect-a-data-source/">Connect a Data Source</a></li> <li><a href="/docs/odbc-jdbc-interfaces/">ODBC/JDBC Interfaces</a></li> <li><a href="/docs/query-data/">Query Data</a></li> <li><a href="/docs/performance-tuning/">Performance Tuning</a></li> <li><a href="/docs/log-and-debug/">Log and Debug</a></li> <li><a href="/docs/sql-reference/">SQL Reference</a></li> <li><a href="/docs/data-sources-and-file-formats/">Data Sources and File Formats</a></li> <li><a href="/docs/develop-custom-functions/">Develop Custom Functions</a></li> <li><a href="/docs/troubleshooting/">Troubleshooting</a></li> <li><a href="/docs/developer-information/">Developer Information</a></li> <li><a href="/docs/release-notes/">Release Notes</a></li> <li><a href="/docs/sample-datasets/">Sample Datasets</a></li> <li><a href="/docs/project-bylaws/">Project Bylaws</a></li> <li><a href="/docs/ecosystem/">Ecosystem</a></li> </ul> </li> <li class='nav'> <a href="/community-resources/">Community</a> <ul> <li><a href="/team/">Team</a></li> <li><a href="/mailinglists/">Mailing Lists</a></li> <li><a href="/community-resources/">Community Resources</a></li> </ul> </li> <li class='nav'><a href="/faq/">FAQ</a></li> <li class='nav'><a href="/blog/">Blog</a></li> <li class="social-menu-item"><a href="https://twitter.com/apachedrill" title="apachedrill on twitter" target="_blank"><img src="/images/twitter_32_26_white.png" alt="twitter logo" align="center"></a> </li> <li class="social-menu-item"><a href="https://join.slack.com/t/apache-drill/shared_invite/enQtNTQ4MjM1MDA3MzQ2LTJlYmUxMTRkMmUwYmQ2NTllYmFmMjU4MDk0NjYwZjBmYjg0MDZmOTE2ZDg0ZjBlYmI3Yjc4Y2I2NTQyNGVlZTc" title="Apache Drill Slack channels" target="_blank"><img src="/images/slack-logo.svg" alt="Slack logo" align="center"></a> </li> <li class='search-bar'> <form id="drill-search-form"> <input type="text" placeholder="Search Apache Drill" id="drill-search-term" /> <button type="submit"> </button> </form> </li> <li class="d"> <a href="/download/"> Download </a> </li> </ul> </div> <div class="int_title"> <h1>Blog</h1> </div> <div class="int_text" align="left"> <a class="post-link" href="/blog/2024/06/23/drill-1.21.2-released/">Drill 1.21.2 Released</a> Posted on Jun 23, 2024 by James Turton Apache Drill 1.21.2 has been released.  <a class="post-link" href="/blog/2023/04/29/drill-1.21.1-released/">Drill 1.21.1 Released</a> Posted on Apr 29, 2023 by James Turton Apache Drill 1.21.1 has been released.  <a class="post-link" href="/blog/2023/03/02/drill-1.21.0-released/">Announcing Drill 1.21!</a> Posted on Mar 2, 2023 by Charles Givre Announcing Drill 1.21: New Connectors, Functions and Much Better Stability.  <a class="post-link" href="/blog/2023/01/07/drill-1.20.3-released/">Drill 1.20.3 Released</a> Posted on Jan 7, 2023 by James Turton Apache Drill 1.20.3 has been released.  <a class="post-link" href="/blog/2022/08/03/drill-1.20.2-released/">Drill 1.20.2 Released</a> Posted on Aug 3, 2022 by James Turton Apache Drill 1.20.2 has been released.  <a class="post-link" href="/blog/2022/05/16/drill-1.20.1-released/">Drill 1.20.1 Released</a> Posted on May 16, 2022 by James Turton Apache Drill 1.20.1 has been released.  <a class="post-link" href="/blog/2022/02/25/drill-1.20-released/">Drill 1.20 Released</a> Posted on Feb 25, 2022 by James Turton Apache Drill 1.20 has been released providing the Apache Phoenix storage plugin with impersonation support, the Apache Iceberg format plugin, expanded push down support for MongoDB, persistent table and storage aliases, a release for Hadoop 2 environments, write support in the JDBC storage plugin, SAS and PDF format plugins, pagination and OAuth support in the HTTP storage plugin, a HashiCorp Vault authentication and credential storage providers and read/write support for all compression codecs and both format versions of Parquet.  <a class="post-link" href="/blog/2022/02/04/2021-in-review/">2021 in Review</a> Posted on Feb 4, 2022 by James Turton A short post to share Cong Luo's slide deck reviewing the Drill project in 2021.  <a class="post-link" href="/blog/2021/10/30/reports-of-my-death/">The reports of my death have been greatly exaggerated</a> Posted on Oct 30, 2021 by James Turton There's a somewhat breathless post entitled "The Death of Apache Drill" in a blog that has as a theme the imminent demise of technologies previously or currently associated with Hadoop, with the exception Trino (formerly known as PrestoSQL).  <a class="post-link" href="/blog/2021/08/05/drill-provider-for-airflow/">Drill provider for Airflow</a> Posted on Aug 5, 2021 by James Turton In its provider package release this month, the Apache Airflow project added a provider for interacting with Apache Drill. This allows data engineers and data scientists to incorporate Drill queries in their Airflow DAGs, enabling the automation of big data and data science workflows.  <a class="post-link" href="/blog/2021/07/09/streaming-data-from-the-rest-api/">Streaming data from the Drill REST API</a> Posted on Jul 9, 2021 by James Turton The release of Apache Drill 1.19 saw a major change under the hood of Drill's REST API with the introduction of a streaming data path for query results moving from Drill and over the network to the initiating client. The result is better memory utilisation, less blocking and a more reliable API.  <a class="post-link" href="/blog/2021/06/10/drill-1.19-released/">Drill 1.19 Released</a> Posted on Jun 10, 2021 by Laurent Goujon Apache Drill 1.19 has been released providing new storage plugins for Cassandra, Elasticsearch and Splunk, updating several storage plugins to EVF, adding Linux ARM64 support and JSON reader improvements, and more.  <a class="post-link" href="/blog/2020/09/05/drill-1.18-released/">Drill 1.18 Released</a> Posted on Sep 5, 2020 by Abhishek Girish Apache Drill 1.18 has been released providing Drill Metadata management "Drill Metastore", Format Plugins for HDF5 and SPSS, Storage Plugins for Generic HTTP REST APIs and Apache Druid, Support for DICT type in RowSet Framework, Dynamic credit based flow control, Support for injecting BufferManager into UDF, Drill RDBMS Metastore"  <a class="post-link" href="/blog/2019/12/26/drill-1.17-released/">Drill 1.17 Released</a> Posted on Dec 26, 2019 by Bridget Bevens Apache Drill 1.17's highlights are: Hadoop, Kafka, Sqlline, and Calcite upgrades, .zip compression, file/table function for schema provisioning, new UDFs, and more.  <a class="post-link" href="/blog/2019/05/02/drill-user-meetup/">Drill User Meetup 2019</a> Posted on May 2, 2019 by Bridget Bevens Drill User Meetup coming soon.  <a class="post-link" href="/blog/2019/05/02/drill-1.16-released/">Drill 1.16 Released</a> Posted on May 2, 2019 by Bridget Bevens Apache Drill 1.16's highlights are: table statistics, schema provisioning for text files, parquet metadata caching improvements, several Web UI improvements, and more.  <a class="post-link" href="/blog/2018/12/31/drill-1.15-released/">Drill 1.15 Released</a> Posted on Dec 31, 2018 by Bridget Bevens Apache Drill 1.15's highlights are: SQLLine upgrade, index support, ability to secure znodes with custom ACLs, INFORMATION_SCHEMA files table, systemfunctions table, and more.  <a class="post-link" href="/blog/2018/12/01/learning-apache-drill-book/">Learning Apache Drill book from O'Reilly Media</a> Posted on Dec 1, 2018 by James Turton A new book for learning to work with Apache Drill from two Drill comitters has been published through O'Reilly Media. The book contains helpful explanations and recipes for different types of user from big data admins to data scientists. It also presents information relevant to developers interested in customising Drill, contributing to the open source project or just taking a peek under the hood.  <a class="post-link" href="/blog/2018/10/16/drill-user-meetup/">Drill User Meetup 2018</a> Posted on Oct 16, 2018 by Bridget Bevens Drill User Meetup coming soon.  <a class="post-link" href="/blog/2018/10/16/drill-developer-day/">Drill Developer Day 2018</a> Posted on Oct 16, 2018 by Bridget Bevens Drill Developer Day coming soon.  <a class="post-link" href="/blog/2018/08/05/drill-1.14-released/">Drill 1.14 Released</a> Posted on Aug 5, 2018 by Bridget Bevens Apache Drill 1.14's highlights are: Ability to run Drill in a Docker container, ability to export and save storage plugin configurations, a storage plugin configuration file to manage storage plugin configurations, an image metadata format plugin, option to set Hive properties at the session level, and more.  <a class="post-link" href="/blog/2018/03/18/drill-1.13-released/">Drill 1.13 Released</a> Posted on Mar 18, 2018 by Bridget Bevens Apache Drill 1.13's highlights are: YARN support, support for HTTP Kerberos authentication using SPNEGO, SQL syntax highlighting of queries, and user and distribution specific configuration checks during startup.  <a class="post-link" href="/blog/2018/02/09/running-sql-queries-on-amazon-s3/">Running SQL Queries on Amazon S3</a> Posted on Feb 9, 2018 by Nick Amato Drill enables you to run SQL queries directly on data in S3. There's no need to ingest the data into a managed cluster or transform the data. This is a step-by-step tutorial on how to use Drill with S3.  <a class="post-link" href="/blog/2017/12/15/drill-1.12-released/">Drill 1.12 Released</a> Posted on Dec 15, 2017 by Bridget Bevens Apache Drill 1.12's highlights are: Kafka and OpenTSDB storage plugins, SSL and network encryption support, queue-based memory assignment for buffering operators, networking functions, and the ability to prevent users from accessing paths outside the root of a workspace.  <a class="post-link" href="/blog/2017/07/31/drill-1.11-released/">Drill 1.11 Released</a> Posted on Jul 31, 2017 by Bridget Bevens Apache Drill 1.11's highlights are: Cryptography-related functions, spill to disk for the hash aggregate operator, Format plugin support for PCAP files, ability to change the HDFS block Size for Parquet files, ability to store query profiles in memory, configurable CTAS directory and file permissions option, support for network encryption, relative paths stored in the metadata file, and support for ANSI_QUOTES.  <a class="post-link" href="/blog/2017/03/15/drill-1.10-released/">Drill 1.10 Released</a> Posted on Mar 15, 2017 by Bridget Bevens Apache Drill 1.10's highlights are: CTTAS, improved fault tolerance, Drill version and statistics in Web Console, implicit interpretation of INT96, and Kerberos authentication.  <a class="post-link" href="/blog/2016/11/29/drill-1.9-released/">Drill 1.9 Released</a> Posted on Nov 29, 2016 by Bridget Bevens Apache Drill 1.9's highlights are: asynchronous Parquet reader, Parquet filter pushdown, dynamic UDF support, and HTTPD format plugin.  <a class="post-link" href="/blog/2016/08/30/drill-1.8-released/">Drill 1.8 Released</a> Posted on Aug 30, 2016 by Bridget Bevens Apache Drill 1.8's highlights are: metadata cache pruning, IF EXISTS support, DESCRIBE SCHEMA command, multi-byte delimiter support, and new parameters for filter selectivity estimates.  <a class="post-link" href="/blog/2016/06/28/drill-1.7-released/">Drill 1.7 Released</a> Posted on Jun 28, 2016 by Bridget Bevens Apache Drill 1.7's highlights are: Monitoring via JMX, Hive CHAR data type support, and HBase 1.x support.  <a class="post-link" href="/blog/2016/03/16/drill-1.6-released/">Drill 1.6 Released</a> Posted on Mar 16, 2016 by Bridget Bevens Apache Drill 1.6's highlights are: Inbound impersonation and additional custom window frames.  <a class="post-link" href="/blog/2016/02/16/drill-1.5-released/">Drill 1.5 Released</a> Posted on Feb 16, 2016 by Jason Altekruse, Bridget Bevens Apache Drill 1.5's highlights are: Authentication and security for the Web interface and REST API, experimental query support for Apache Kudu (incubating), an improved memory allocator, and configurable caching for Hive metadata.  <a class="post-link" href="/blog/2015/12/14/drill-1.4-released/">Drill 1.4 Released</a> Posted on Dec 14, 2015 by Jacques Nadeau Apache Drill 1.4's highlights are: "select with options" queries that can change storage plugin settings, improved behavior when parsing CSV file header names, a variable to set non-pretty (e.g. compact) printing of JSON, and better drillbit.log files that include query text.  <a class="post-link" href="/blog/2015/11/23/drill-1.3-released/">Drill 1.3 Released</a> Posted on Nov 23, 2015 by Jacques Nadeau Drill 1.3 has been released. Users can now query Hadoop sequence files and text delimited files with headers. In addition, this release provides significant performance and usability improvements for working with Amazon S3. Drill 1.3 also adds support for heterogeneous types, enabling queries on datasets with columns that have more than one data type (commonly seen in JSON files, MongoDB collections, etc.).  <a class="post-link" href="/blog/2015/10/16/drill-1.2-released/">Drill 1.2 Released</a> Posted on Oct 16, 2015 by Jacques Nadeau Drill 1.2 has been released. This release includes a new JDBC storage plugin for querying relational databases, as well as new window functions such as `NTILE`, `FIRST_VALUE`, `LAST_VALUE`, `LEAD` and `LAG`. This release addresses 210 JIRAs, including performance, stability and documentation enhancements.  <a class="post-link" href="/blog/2015/07/23/drill-tutorial-at-nosql-now-2015/">Drill Tutorial at NoSQL Now! 2015</a> Posted on Jul 23, 2015 by Tomer Shiran Attend the 3-hour Drill tutorial at the NoSQL Now! 2015 conference to learn more about Apache Drill.  <a class="post-link" href="/blog/2015/07/05/drill-1.1-released/">Drill 1.1 Released</a> Posted on Jul 5, 2015 by Jacques Nadeau Drill 1.1 has been released, providing window functions, automatic partitioning, improved MongoDB support and more. This release addresses 162 JIRAs.  <a class="post-link" href="/blog/2015/05/19/the-apache-software-foundation-announces-apache-drill-1.0/">The Apache Software Foundation Announces Apache Drill 1.0</a> Posted on May 19, 2015 by Tomer Shiran The Apache Software Foundation announced today the availability of Apache Drill 1.0, the schema-free SQL query engine for Apache Hadoop, NoSQL and cloud storage.  <a class="post-link" href="/blog/2015/05/19/drill-1.0-released/">Drill 1.0 Released</a> Posted on May 19, 2015 by Tomer Shiran, Jacques Nadeau Drill 1.0 has been released, representing a major milestone for the Drill community. Drill in now production-ready, making it easier than ever to explore and analyze data in non-relational datastores.  <a class="post-link" href="/blog/2015/05/04/drill-0.9-released/">Drill 0.9 Released</a> Posted on May 4, 2015 by Tomer Shiran, Jacques Nadeau The community has just released Drill 0.9, which includes 199 resolved JIRAs and numerous enhancements.  <a class="post-link" href="/blog/2015/04/30/apache-parquet-graudates-to-a-top-level-project/">Apache Parquet Graduates to a Top-Level Project</a> Posted on Apr 30, 2015 by Tomer Shiran The Apache Parquet project has graduated to a top-level project (TLP) at the Apache Software Foundation.  <a class="post-link" href="/blog/2015/03/31/drill-0.8-released/">Drill 0.8 Released</a> Posted on Mar 31, 2015 by Tomer Shiran, Jacques Nadeau The community has just released Drill 0.8, which includes 243 resolved JIRAs and numerous enhancements.  <a class="post-link" href="/blog/2015/03/23/microstrategy-announces-drill-support/">MicroStrategy Announces Drill Support</a> Posted on Mar 23, 2015 by Tomer Shiran MicroStrategy announced that it is now certified with Apache Drill, providing a first-class BI experience for Hadoop and NoSQL databases.  <a class="post-link" href="/blog/2015/01/27/schema-free-json-data-infrastructure/">Schema-free JSON Data Infrastructure</a> Posted on Jan 27, 2015 by Tomer Shiran JSON has emerged as the de-facto standard data exchange format. Data infrastructure technologies such as Apache Drill, MongoDB and Elasticsearch are embracing JSON as their native data models, bringing game-changing ease-of-use and agility to developers and analysts.  <a class="post-link" href="/blog/2014/12/23/drill-0.7-released/">Drill 0.7 Released</a> Posted on Dec 23, 2014 by Jacques Nadeau The community has just released Drill 0.7, which includes 228 resolved JIRAs and numerous enhancements.  <a class="post-link" href="/blog/2014/12/16/whats-coming-in-2015/">What's Coming in 2015?</a> Posted on Dec 16, 2014 by Tomer Shiran Drill is now a top-level project, and the community is expanding rapidly. Find out more about some of the new features planned for 2015.  <a class="post-link" href="/blog/2014/12/11/apache-drill-qa-panelist-spotlight/">Apache Drill Q&A Panelist Spotlight</a> Posted on Dec 11, 2014 by Tomer Shiran Join us on Twitter for a live Q&A on Wednesday, December 17.  <a class="post-link" href="/blog/2014/12/02/drill-top-level-project/">Apache Drill Graduates to a Top-Level Project</a> Posted on Dec 2, 2014 by Tomer Shiran Drill has graduated to a Top-Level Project at Apache. This marks a significant accomplishment for the Drill community, which now includes dozens of developers working at a variety of companies.  <a class="post-link" href="/blog/2014/11/19/sql-on-mongodb/">SQL on MongoDB</a> Posted on Nov 19, 2014 by Anil Kumar Batchu, Kamesh Bhallamudi The MongoDB storage plugin for Drill enables analytical queries on MongoDB databases. Drill's schema-free JSON data model is a natural fit for MongoDB's data model. Want to contribute a blog post? Check out the source for some of the <a href="https://github.com/apache/drill-site/tree/master/blog/_posts">existing posts</a> to see how it's done. When you're ready, email your Markdown file to <a href="mailto:dev@drill.apache.org">dev@drill.apache.org</a>. <h1>Third-Party Articles</h1>  <a class="post-link" href="https://www.mapr.com/blog/how-turn-raw-data-yelp-insights-minutes-apache-drill">How to Turn Raw Data from Yelp into Insights in Minutes with Apache Drill</a> (Nov 13, 2014)  <a class="post-link" href="https://www.mapr.com/blog/how-use-sql-hadoop-drill-rest-json-nosql-and-hbase-simple-rest-client">How to Use SQL, Hadoop, Drill, REST, JSON, NoSQL, and HBase in a Simple REST Client</a> (Jan 6, 2015) </div> </div> <div id="footer" class="mw"> <div class="wrapper"> Copyright 漏 2012-2022 The Apache Software Foundation, licensed under the Apache License, Version 2.0. Apache and the Apache feather logo are trademarks of The Apache Software Foundation. Other names appearing on the site may be trademarks of their respective owners. </div> </div> <script> (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) })(window,document,'script','https://www.google-analytics.com/analytics.js','ga'); ga('create', 'UA-53379651-1', 'auto'); ga('send', 'pageview'); </script> <script type="text/javascript" src="https://s7.addthis.com/js/300/addthis_widget.js#pubid=ra-548b2caa33765e8d" async="async"></script> </body> </html>