CINXE.COM

<!DOCTYPE html> <html lang="en-US"> <head> <meta charset="UTF-8">  <title>Dogsheep | dogsheep.github.io</title> <meta name="generator" content="Jekyll v3.9.3" /> <meta property="og:title" content="Dogsheep" /> <meta property="og:locale" content="en_US" /> <meta name="description" content="Tools for personal analytics using SQLite and Datasette" /> <meta property="og:description" content="Tools for personal analytics using SQLite and Datasette" /> <link rel="canonical" href="https://dogsheep.github.io/" /> <meta property="og:url" content="https://dogsheep.github.io/" /> <meta property="og:site_name" content="dogsheep.github.io" /> <meta property="og:type" content="website" /> <meta name="twitter:card" content="summary" /> <meta property="twitter:title" content="Dogsheep" /> <script type="application/ld+json"> {"@context":"https://schema.org","@type":"WebSite","description":"Tools for personal analytics using SQLite and Datasette","headline":"Dogsheep","name":"dogsheep.github.io","url":"https://dogsheep.github.io/"}</script>  <link rel="preconnect" href="https://fonts.gstatic.com"> <link rel="preload" href="https://fonts.googleapis.com/css?family=Open+Sans:400,700&display=swap" as="style" type="text/css" crossorigin> <meta name="viewport" content="width=device-width, initial-scale=1"> <meta name="theme-color" content="#157878"> <meta name="apple-mobile-web-app-status-bar-style" content="black-translucent"> <link rel="stylesheet" href="/assets/css/style.css?v=41a45e77196bc560a7802dc9788600520e08b189">      </head> <body> <a id="skip-to-content" href="#content">Skip to the content.</a> <header class="page-header" role="banner"> <h1 class="project-name">Dogsheep</h1> <h2 class="project-tagline">Tools for personal analytics using SQLite and Datasette</h2> </header> <main id="content" class="main-content" role="main"> <h1 id="dogsheep">Dogsheep</h1> <p>Dogsheep is a collection of tools for <em>personal analytics</em> using <a href="https://www.sqlite.org/">SQLite</a> and <a href="https://github.com/simonw/datasette">Datasette</a>.</p> <p>Big internet companies know a <em>lot</em> about us. By exporting that data back out of them we can see what they know and maybe learn something interesting about ourselves.</p> <p>Read more about Dogsheep on my blog: <a href="https://simonwillison.net/tags/dogsheep/">simonwillison.net/tags/dogsheep</a></p> <p>Watch <a href="https://simonwillison.net/2020/Nov/14/personal-data-warehouses/">Personal Data Warehouses: Reclaiming Your Data</a> for a demo of Dogsheep in action.</p> <h2 id="dogsheep-tools">Dogsheep tools</h2> <p>These tools, maintained by the Dogsheep project, let you export your data into a SQLite database for further analysis.</p> <ul> <li><strong><a href="https://github.com/dogsheep/twitter-to-sqlite">twitter-to-sqlite</a></strong> uses the Twitter API or Twitter’s “export your data” zip archive to create a database of your tweets, followers, people you follow, favourited tweets and much more besides.</li> <li><strong><a href="https://github.com/dogsheep/healthkit-to-sqlite">healthkit-to-sqlite</a></strong> converts your Apple HealthKit export into a database, with details of your heart rate, workouts, step count and more.</li> <li><strong><a href="https://github.com/dogsheep/swarm-to-sqlite">swarm-to-sqlite</a></strong> imports your checkin history from Foursquare Swarm.</li> <li><strong><a href="https://datasette.io/tools/apple-notes-to-sqlite">apple-notes-to-sqlite</a></strong> saves Apple Notes data to a database.</li> <li><strong><a href="https://github.com/dogsheep/inaturalist-to-sqlite">inaturalist-to-sqlite</a></strong> imports the wildlife and plants you have spotted on <a href="https://www.inaturalist.org/">iNaturalist</a>.</li> <li><strong><a href="https://github.com/dogsheep/google-takeout-to-sqlite">google-takeout-to-sqlite</a></strong> imports data from Google Takeout, which can include your Google Maps location history, your search history on Google and more to come.</li> <li><strong><a href="https://github.com/dogsheep/genome-to-sqlite">genome-to-sqlite</a></strong> imports your genome from <a href="https://www.23andme.com/">23andMe</a> into a SQLite database.</li> <li><strong><a href="https://github.com/dogsheep/github-to-sqlite">github-to-sqlite</a></strong> imports repositories you have created or starred on GitHub.</li> <li><strong><a href="https://github.com/dogsheep/pocket-to-sqlite">pocket-to-sqlite</a></strong> imports articles you have saved using <a href="https://getpocket.com/">Pocket</a>.</li> <li><strong><a href="https://github.com/dogsheep/hacker-news-to-sqlite">hacker-news-to-sqlite</a></strong> imports stories and comments posted to <a href="https://news.ycombinator.com/">Hacker News</a>.</li> <li><strong><a href="https://github.com/dogsheep/dogsheep-photos">dogsheep-photos</a></strong> imports metadata about photos from Apple Photos, including machine learning labels. See <a href="https://simonwillison.net/2020/May/21/dogsheep-photos/">Using SQL to find my best photo of a pelican according to Apple Photos</a>.</li> <li><strong><a href="https://github.com/dogsheep/dogsheep-beta">dogsheep-beta</a></strong> is a search index which combines data from all of the other sources into a single faceted search interface.</li> <li><strong><a href="https://github.com/dogsheep/evernote-to-sqlite">evernote-to-sqlite</a></strong> converts exported Evernote files in the ENEX format into a SQLite database.</li> </ul> <h2 id="tools-by-other-developers">Tools by other developers</h2> <p>These tools help bring the Dogsheep philosophy to life.</p> <ul> <li><strong><a href="https://github.com/bcongdon/beeminder-to-sqlite">beeminder-to-sqlite</a></strong> by Ben Congdon saves your goals and data points from <a href="https://www.beeminder.com/">Beeminder</a>.</li> <li><strong><a href="https://github.com/rixx/goodreads-to-sqlite">goodreads-to-sqlite</a></strong> by Tobias Kunze imports your reading history from <a href="https://www.goodreads.com/">Goodreads</a>.</li> <li><strong><a href="https://github.com/jacobian/pinboard-to-sqlite">pinboard-to-sqlite</a></strong> by Jacob Kaplan-Moss saves your bookmarks from <a href="https://pinboard.in/">Pinboard</a>.</li> <li><strong><a href="https://github.com/bcongdon/todoist-to-sqlite">todoist-to-sqlite</a></strong> by Ben Congdon saves your tasks and projects from <a href="https://todoist.com/">Todoist</a>.</li> <li><strong><a href="https://github.com/mrw34/parkrun-to-sqlite">parkrun-to-sqlite</a></strong> by Mark Woodbridge imports your <a href="https://www.parkrun.com">parkruns</a>.</li> </ul> <footer class="site-footer"> <span class="site-footer-credits">This page was generated by <a href="https://pages.github.com">GitHub Pages</a>.</span> </footer> </main> </body> </html>