CINXE.COM

<!DOCTYPE html><html lang="en"> <head><meta charSet="utf-8"/><meta name="viewport" content="width=device-width"/><link rel="icon" href="/assets/favicon.ico"/><script defer="" data-domain="star-history.com" src="https://plausible.io/js/script.js"></script><meta name="next-head-count" content="4"/><link data-next-font="size-adjust" rel="preconnect" href="/" crossorigin="anonymous"/><link rel="preload" href="/_next/static/css/f94657194d4c857a.css" as="style" crossorigin=""/><link rel="stylesheet" href="/_next/static/css/f94657194d4c857a.css" crossorigin="" data-n-g=""/><noscript data-n-css=""></noscript><script defer="" crossorigin="" nomodule="" src="/_next/static/chunks/polyfills-c67a75d1b6f99dc8.js"></script><script src="/_next/static/chunks/webpack-38cee4c0e358b1a3.js" defer="" crossorigin=""></script><script src="/_next/static/chunks/framework-fda0a023b274c574.js" defer="" crossorigin=""></script><script src="/_next/static/chunks/main-001c9e19b1894c7d.js" defer="" crossorigin=""></script><script src="/_next/static/chunks/pages/_app-915effad870aa62e.js" defer="" crossorigin=""></script><script src="/_next/static/chunks/6c86d9ce-d8b7531786dd65a5.js" defer="" crossorigin=""></script><script src="/_next/static/chunks/472-8057db644de3d496.js" defer="" crossorigin=""></script><script src="/_next/static/chunks/590-4cf86cd34751f8c0.js" defer="" crossorigin=""></script><script src="/_next/static/chunks/pages/blog/%5Bslug%5D-7b378153203b51eb.js" defer="" crossorigin=""></script><script src="/_next/static/No_9KKRmcmQTzlR6_xY3n/_buildManifest.js" defer="" crossorigin=""></script><script src="/_next/static/No_9KKRmcmQTzlR6_xY3n/_ssgManifest.js" defer="" crossorigin=""></script></head><body><div id="__next"><div class="relative w-full h-auto min-h-screen overflow-auto flex flex-col"><title>Star History Open Source Best of 2022 | Data, Infra & DevTools</title><meta name="description" content="Following up on the previous roundup of top front-end os projects, Star History looks at some of the lesser known open-source projects under the category of data/infra/tools in 2022."/><meta property="og:type" content="website"/><meta property="og:url" content="https://star-history.com/blog/star-history-yearly-pick-2022-data-infra-devtools"/><meta property="og:title" content="Star History Open Source Best of 2022 | Data, Infra & DevTools"/><meta property="og:description" content="Following up on the previous roundup of top front-end os projects, Star History looks at some of the lesser known open-source projects under the category of data/infra/tools in 2022."/><meta property="og:image" content="https://star-history.com/assets/blog/yearly-pick-data-infra-devtools-2022/yearly-pick-data-infra-devtools-2022.webp"/><meta name="twitter:card" content="summary_large_image"/><meta name="twitter:url" content="https://star-history.com/blog/star-history-yearly-pick-2022-data-infra-devtools"/><meta name="twitter:title" content="Star History Open Source Best of 2022 | Data, Infra & DevTools"/><meta name="twitter:description" content="Following up on the previous roundup of top front-end os projects, Star History looks at some of the lesser known open-source projects under the category of data/infra/tools in 2022."/><meta name="twitter:image" content="https://star-history.com/assets/blog/yearly-pick-data-infra-devtools-2022/yearly-pick-data-infra-devtools-2022.webp"/><nav><div class="flex justify-center items-center gap-x-6 bg-green-600 px-6 py-1 sm:px-3.5 "><p class="text-sm leading-6 text-white"><a href="/blog/list-your-open-source-project">Want to promote your open source project? Be on our ⭐️Starlet List⭐️ for FREE →</a></p></div></nav><header class="w-full h-14 shrink-0 flex flex-row justify-center items-center bg-[#363636] text-light"><div class="w-full md:max-w-5xl lg:max-w-7xl h-full flex flex-row justify-between items-center px-0 sm:px-4"><div class="h-full bg-dark flex flex-row justify-start items-center"><a class="h-full flex flex-row justify-center items-center px-3 hover:bg-zinc-800" href="/"><img class="w-7 h-auto" src="/assets/icon.png" alt="Logo"/></a><a class="h-full flex flex-row justify-center items-center text-base px-3 hover:bg-zinc-800" href="/blog"><span class="text-white font-semibold -2">Blog</span></a><span class="h-full flex flex-row justify-center items-center cursor-pointer text-white text-base px-3 font-semibold mr-2 hover:bg-zinc-800">Add Access Token</span></div><div class="hidden h-full md:flex flex-row justify-start items-center"><a target="_blank" rel="noopener noreferrer" class="h-full flex text-white text-base flex-row justify-center items-center px-4 hover:bg-zinc-800" href="https://www.bytebase.com/?source=star-history"><img class="h-6 mt-1 mr-2" src="/assets/craft-by-bytebase.webp" alt=""/></a></div><div class="h-full hidden md:flex flex-row justify-end items-center space-x-2"><a class="h-full flex flex-row justify-center items-center px-2 hover:bg-zinc-800" href="https://twitter.com/StarHistoryHQ" target="_blank" rel="noopener noreferrer"><i class="fab fa-twitter text-2xl text-blue-300"></i></a></div><div class="h-full flex md:hidden flex-row justify-end items-center"><span class="relative h-full w-10 px-3 flex flex-row justify-center items-center cursor-pointer font-semibold text-light hover:bg-zinc-800"><span class="w-4 transition-all h-px bg-light absolute top-1/2 -mt-1"></span><span class="w-4 transition-all h-px bg-light absolute top-1/2 "></span><span class="w-4 transition-all h-px bg-light absolute top-1/2 mt-1"></span></span></div></div></header><div class="w-full h-auto py-2 flex md:hidden flex-col justify-start items-start shadow-lg border-b hidden"><a class="h-12 text-base px-3 w-full flex flex-row justify-start items-center cursor-pointer font-semibold text-dark mr-2 hover:bg-gray-100 hover:text-blue-500" href="/blog/how-to-use-github-star-history">📕 How to use this site</a><span class="h-12 px-3 text-base w-full flex flex-row justify-start items-center cursor-pointer font-semibold text-dark mr-2 hover:bg-gray-100 hover:text-blue-500">Add Access Token</span><span class="h-12 text-base px-3 w-full flex flex-row justify-start items-center"><a class="github-button -mt-1" href="https://github.com/star-history/star-history" data-show-count="true" aria-label="Star star-history/star-history on GitHub" target="_blank" rel="noopener noreferrer">Star</a></span></div><div class="w-full h-auto grow lg:grid lg:grid-cols-[256px_1fr_256px]"><div class="w-full hidden lg:block"><div class="flex flex-col justify-start items-start w-full mt-2 p-4 pl-8"><a class="hover:opacity-75" href="/blog/list-your-open-source-project"><img class="w-auto max-w-full" src="/assets/starlet-icon.webp"/></a><div><div class="w-full flex flex-row justify-between items-center my-2"><h3 class="text-sm font-medium text-gray-400 leading-6">Playbook</h3></div><ul class="list-disc list-inside"><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/how-to-use-github-star-history"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">📕 How to Use this Site</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/playbook-for-more-github-stars"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">⭐️ How to Get More Stars</span></a></li></ul></div><div><div class="w-full flex flex-row justify-between items-center my-2"><h3 class="text-sm font-medium text-gray-400 leading-6">Monthly Pick</h3></div><ul class="list-disc list-inside"><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/deepseek"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2025 Feb (DeepSeek)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/knowledge-management"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2025 Jan (Knowledge Management)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/ai-data-visualization"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Dec (AI Data Visualization)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/ai-devtools"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Nov (AI DevTools)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/homelab"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Oct (Homelab)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/ai-agents"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Sep (AI Agents)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/rag-frameworks"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Aug (RAG Frameworks)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/ai-generators"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Jul (AI Generators)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/ai-search"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Jun (AI Searches)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/ai-web-scraper"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 May (AI Web Scraper)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/prompt-engineering"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Apr (AI Prompt)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/non-ai"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Mar (Non-AI)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/most-underrated"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Feb (Most Underrated)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/text2sql"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024 Jan (Text2SQL)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/gpt-wrappers"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Dec (GPT Wrappers)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/tts"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Nov (TTS)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/ai-for-postgres"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Oct (AI for Postgres)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/coding-ai"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Sept (Coding AI)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/cli-tool-for-llm"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Aug (CLI tool for LLMs)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/llama2"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 July (Llama 2 Edition)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-monthly-pick-202306"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 June</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-monthly-pick-202305"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 May</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-monthly-pick-202304"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Apr</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-monthly-pick-202303"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Mar (ChatGPT Edition)</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-monthly-pick-202302"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Feb</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-monthly-pick-202301"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023 Jan</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-monthly-pick-202212"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2022 Dec</span></a></li></ul></div><div><div class="w-full flex flex-row justify-between items-center my-2"><h3 class="text-sm font-medium text-gray-400 leading-6">Yearly Pick</h3></div><ul class="list-disc list-inside"><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/best-of-2024"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2024</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/best-of-2023"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2023</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-yearly-pick-2022-data-infra-devtools"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2022 Data, Infra & DevTools</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-open-source-2022-platform-engineering"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2022 Platform Engineering</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-open-source-2022-open-source-alternatives"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2022 OSS Alternatives</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/star-history-yearly-pick-2022-frontend"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">2022 Front-end</span></a></li></ul></div><div><div class="w-full flex flex-row justify-between items-center my-2"><h3 class="text-sm font-medium text-gray-400 leading-6">Starlet List</h3></div><ul class="list-disc list-inside"><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/list-your-open-source-project"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">🎁 Prompt yours for FREE</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/trench"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #28 - Trench</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/langfuse"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #27 - langfuse</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/thepipe"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #26 - thepi.pe</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/taipy"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #25 - Taipy</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/superlinked"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #24 - Superlinked</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/tea-tasting"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #23 - tea-tasting</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/giskard"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #22 - Giskard</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/khoj"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #21 - Khoj</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/paradedb"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #20 - ParadeDB</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/skyvern"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #19 - Skyvern</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/prisma"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #18 - Prisma</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/spicedb"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #17 - SpiceDB</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/answer"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #16 - Apache Answer</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/infinity"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #15 - Infinity</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/proton"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #14 - Proton</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/earthly"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #13 - Earthly</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/wasp"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #12 - Wasp</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/libsql"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #11 - libSQL</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/postgresml"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #10 - PostgresML</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/electricsql"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #9 - ElectricSQL</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/prompt-flow"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #8 - Prompt flow</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/clipboard"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #7 - Clipboard</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/hoppscotch"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #6 - Hoppscotch</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/metisfl"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #5 - MetisFL</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/chatgpt-js"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #4 - chatgpt.js</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/mockoon"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #3 - Mockoon</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/dlta-ai"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #2 - DLTA-AI</span></a></li><li class="mb-2 leading-3"><a class="cursor-pointer" rel="noopener noreferrer" href="/blog/sniffnet"><span class="inline -ml-2 text-sm text-blue-700 hover:underline">Issue #1 - Sniffnet</span></a></li></ul></div></div></div><div class="w-full flex flex-col justify-start items-center"><div class="w-full p-4 md:p-0 mt-6 md:w-5/6 lg:max-w-6xl h-full flex flex-col justify-start items-center self-center"><img class="hidden md:block w-auto max-w-full object-scale-down" src="/assets/blog/yearly-pick-data-infra-devtools-2022/yearly-pick-data-infra-devtools-2022.webp" alt=""/><div class="w-auto max-w-6xl mt-4 md:mt-12 prose prose-indigo prose-xl md:prose-2xl flex flex-col justify-center items-center"><h1 class="leading-16">Star History Open Source Best of 2022 | Data, Infra & DevTools</h1></div><div class="w-full mt-8 mb-2 max-w-6xl px-2 flex flex-row items-center justify-center text-sm text-gray-900 font-semibold trackingwide uppercase"><div class="flex space-x-1 text-gray-500"><span class="text-gray-900">Mila</span><span aria-hidden="true"> · </span><time dateTime="2023-01-11T09:50:06.000Z">Jan 11, 2023</time><span aria-hidden="true"> · </span><span> 7 min read </span></div></div><div class="mt-8 w-full max-w-5xl prose prose-indigo prose-xl md:prose-2xl"><p>Following up on our previous roundup of <a href="/blog/star-history-yearly-pick-2022-frontend">Top Front-end open-source projects in 2022</a>, Star History will round up the open-source projects that stood out in the <strong>Data, Infra, and DevTools</strong> section in 2022.</p> <p>If you didn’t know, <a href="/">star-history.com</a> is a place to view and compare the star history of GitHub repos. We are proud to say that it is the de facto place people turn to for GitHub stars: it is, after all, the first (and second) result on Google. 😆</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/google-result.webp" alt="google-result"></p> <p>*Note: the list is in alphabetical order.</p> <h2>Buf</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/buf.webp" alt="buf"></p> <p><a href="https://github.com/bufbuild/buf">Buf</a> is a very low-profile company based in Toronto that focuses on improving the developer experience with Protocol Buffers. Their mission is to deprecate REST/JSON and move the industry towards a schema-driven development model with Protobuf. Their products the Buf CLI and Buf Schema Registry help engineers shift most of their time and effort from managing Protobuf files to implementing features and working on their infrastructure.</p> <p>Buf closed a $68M Series B at the end of 2021 and has kept a low profile for all four rounds of funding, with <a href="https://buf.build/blog/an-update-on-our-fundraising">the only official statement</a> says that they want people to focus on the API and Protobuf ecosystem, rather than how the company is financing the journey (alas, funding is still a big part of the journey).</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/buf-site.webp" alt="buf-site"></p> <h2>Bytebase</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/bytebase.webp" alt="bytebase"></p> <p>While the aforementioned Buf targets the API schema, <a href="https://github.com/bytebase/bytebase">Bytebase</a> targets the database schema hidden behind the API. While there are a number of commercial/open-source database engines on the market, there are only a few tools around to ensure reliable database schema changes. To this day, many engineering teams continue to connect directly to production databases to change data. 💥</p> <ul> <li>Like how GitHub/GitLab manages code changes, Bytebase provides a GUI to manage database changes.</li> <li>Like Figma for designer team collaboration, Bytebase helps DevOps teams collaborate on database management.</li> <li>Like how Terraform defines Infrastructure-as-Code, Bytebase aims to build Database-as-Code.</li> </ul> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/bytebase-site.webp" alt="bytebase-site"></p> <p>Bytebase is a Database CI/CD tool (Database-as-Code) for DevOps teams, built for developers and DBAs, and the first (and at the time of this post, only) <a href="https://www.bytebase.com/blog/cncf-landscape">Database CI/CD solution to be included in the CNCF Landscape</a>.</p> <p>The mascots Byte and Base (originated from Bytebase's B, and the shape of a database, respectively) are also adorable.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/byte-base.gif" alt="byte-base"></p> <h2>Casdoor</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/casdoor.webp" alt="casdoor"></p> <p><a href="https://github.com/casdoor/casdoor">Casdoor</a> is a centralized authentication / SSO platform based on OAuth 2.0 / OIDC. Casdoor is responsible for authentication, but it can also be integrated with <a href="https://github.com/casbin/casbin">Casbin</a>, which is responsible for authorization.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/casdoor-authentication.webp" alt="casdoor-authentication"></p> <h2>Dagger</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/dagger.webp" alt="dagger"></p> <p><a href="https://github.com/dagger/dagger">Dagger</a> is a new offering from Docker founder Solomon Hykes: a portable devkit for CI/CD pipelines. Along with the <a href="https://dagger.io/blog/public-launch-announcement">public launch announcement</a>, Solomon also announced that Dagger has received $20M in <a href="https://dagger.io/blog/series-a">Series A</a> funding.</p> <p>With pipelines configured differently across platforms, engineering teams struggle to cobble together all the pipelines that are difficult to scale or migrate to other cloud platforms, which not only doesn't save labor or time, but makes the deployment painful. DevOps engineers using Dagger can define their pipeline, put together the pieces (think Lego), and implement them all in code that will work on any cloud.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/dagger-architecture.webp" alt="dagger-architecture"></p> <p>BTW: loving the western + docker vibe here. 🤠⚓️</p> <h2>DuckDB</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/duckdb.webp" alt="duckdb"></p> <p><a href="https://github.com/duckdb/duckdb">DuckDB</a> is similar in architecture to SQLite in that it is also an embeddable database. The difference is that SQLite focuses on OLTP transactions, while DuckDB aims to be its counterpart for OLAP transactions.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/duckdb-dbms.webp" alt="duckdb-dbms"></p> <p>MotherDuck, which recently announced <a href="https://motherduck.com/blog/announcing-series-seed-and-a/">$47.5M Series A funding</a>, is based on DuckDB.</p> <h2>Meltano</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/meltano.webp" alt="meltano"></p> <p>Created at GitLab in 2018, <a href="https://github.com/meltano/meltano">Meltano</a> was initially built for GitLab's data and analytics teams. It is a data platform for the DataOps era, designed to help data teams assemble various products on the data platform and manage the entire lifecycle, allowing for version control, code review, continuous integration and deployment (CI/CD), and containerization.</p> <p>It became <a href="https://about.gitlab.com/press/releases/2021-06-30-meltano-spins-out-of-gitlab-raises-seed-funding-led-by-gv.html">a separate startup</a> from GitLab in 2021. The source code was initially hosted in GitLab, but <a href="https://meltano.com/blog/why-meltano-is-moving-to-github/">migrated from GitLab to GitHub</a> in mid-2022, and soon after, it also raised a $12.4M seed round and launched Meltano 2.0 (2022 was a big year for them).</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/meltano-workflow.webp" alt="meltano-workflow"></p> <h2>Neon</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/neon.webp" alt="neon"></p> <p><a href="https://github.com/neondatabase/neon">Neon</a> is a startup that offers serverless Postgres databases for developers and has received $30M in <a href="https://neon.tech/blog/funding-a1/">Series A-1</a> funding. Besides their product, the visuals the team has come up with is really eye-catching: the cute Postgres elephant becomes a real elephant.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/neon-visuals.webp" alt="neon-visuals"></p> <p>Neon CEO Nikita Shamgunov was an engineer at Microsoft SQL Server and Meta before founding SingleStore. In 2021, he founded Neon with Heikki Linnakangas (previously a Postgres hacker) and Stas Kelvich (previously on the Yandex database team).</p> <p>They realized that Postgres could be cheaper and more efficient in the cloud by separating storage and compute. As their tagline suggests, Neon is a serverless Postgres built for the cloud. Compute nodes are activated only when a connection comes in and are automatically shut down during periods of inactivity. Regarding storage, cold data can be offloaded to S3 to save costs.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/neon-architecture.webp" alt="neon-architecture"></p> <p>In addition to serverless, another big part of Neon is its focus on the developer workflow. They recently introduced <a href="https://neon.tech/docs/introduction/branching/">Branching</a>, and you can branch your data in the same way you branch your code.</p> <h2>Opa</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/opa.webp" alt="opa"></p> <p><a href="https://github.com/open-policy-agent/opa">Open Policy Agent (OPA)</a> is a full-featured policy engine designed to separate policy decisions from software and unify policy enforcement across different platforms and systems. Notably, it is a CNCF incubated (<a href="https://www.cncf.io/announcements/2021/02/04/cloud-native-computing-foundation-announces-open-policy-agent-graduation/">graduated in 2021</a>) project.</p> <p>OPA's policies are expressed using Rego, a high-level declarative language. Rego makes it easy to define policies and configure policies (Policy-as-Code) as if you were writing code. For example, questions like: Is Bob allowed to make GET requests to <code>/api/v1/products</code>? What records does he have permission to view?</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/opa-workflow.webp" alt="opa-workflow"></p> <p>OPA's <a href="https://github.com/open-policy-agent/opa/blob/main/ADOPTERS.md">Adopter.md</a> includes a number of big names using OPA in prod: Netflix, Pinterest, T-Mobile, etc. The syntax for policies has yet to be standardized, leading to everyone having to build the same wheels repeatedly, and OPA has the potential to change that.</p> <h2>Steampipe</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/steampipe.webp" alt="steampipe"></p> <p>With <a href="https://github.com/turbot/steampipe">Steampipe</a>, you can use SQL to instantly query your cloud services (AWS, Azure, GCP, and more). <a href="https://steampipe.io/docs/cloud/overview">Steampipe Cloud</a>, a fully managed SaaS platform for hosting Steampipe instances, was released January, 2022.</p> <p>Steampipe's star skyrocketed in October, 2022, thanks to landing on the <a href="https://news.ycombinator.com/item?id=33034351">Hacker News</a> front page.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/steampipe-hn.webp" alt="steampipe-hn"></p> <h2>Tier</h2> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/tier.webp" alt="tier"></p> <p><a href="https://github.com/tierrun/tier">Tier</a> is a tool to manage pricing and billing workflow for your SaaS offering</p> <p>Tier landed on <a href="https://news.ycombinator.com/item?id=33429972">Hacker News front page</a>, and their stars skyrocketed, just like Steampipe.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/tier-hn.webp" alt="tier-hn"></p> <p>Pricing SaaS products is a constant WIP, but it is a complex task and is often tied up in complex workflows and hidden cross-organizational dependencies. Many startups choose a pricing strategy for their product once, which stays the same forever.</p> <p>Tier has a top-level design for how to implement pricing that allows for changes to pricing models without changing application code or business processes (Pricing as Code). The founding team thoroughly thought about pricing and built a website explaining t<a href="https://priceops.org/">he 5 Pillars of PriceOps</a>.</p> <p><img src="/assets/blog/yearly-pick-data-infra-devtools-2022/tier-priceops.webp" alt="tier-priceops"></p> <p>For Star History, our goal is to discover interesting and inspiring projects. The aforementioned projects are not household names in the open-source community (yet), but each has great potential since they are tackling genuine issues with novel ideas. We see that the <strong>Data & Infra & DevTools</strong> section can be divided into two main categories:</p> <ul> <li>Vertical innovation: database engines being the most popular segment, such as DuckDB and Neon.</li> <li>Horizontal unification and standardization:<ul> <li>Buf for API development.</li> <li>Bytebase for database development.</li> <li>Casdoor for authentication sources.</li> <li>Dagger for pipeline deployments.</li> <li>Meltano for data platforms.</li> <li>Opa for policy configurations.</li> <li>Steampipe for accessing cloud resources across different cloud providers.</li> <li>Tier for SaaS pricing infrastructure.</li> </ul> </li> </ul> <p>We are sure these projects will perform in the coming years and we can’t wait to see what’s next for them.</p> <hr> <p>This is part of Star History Open Source 2022 series, you can continue with:</p> <ol> <li><a href="/blog/star-history-yearly-pick-2022-frontend">Open Source Best of 2022 - Front-end</a></li> <li><a href="/blog/star-history-open-source-2022-platform-engineering">Open Source Best of 2022 - Platform Engineering</a></li> <li><a href="/blog/star-history-open-source-2022-open-source-alternatives">Open Source Best of 2022 - Open-Source Alternatives</a></li> </ol> </div></div><div class="mt-12"><iframe src="https://embeds.beehiiv.com/2803dbaa-d8dd-4486-8880-4b843f3a7da6?slim=true" data-test-id="beehiiv-embed" height="52" frameBorder="0" scrolling="no" style="margin:0;border-radius:0px !important;background-color:transparent"></iframe></div></div><div class="w-full hidden lg:block"></div></div><footer class="relative w-full shrink-0 h-auto mt-6 flex flex-col justify-end items-center"><div class="w-full py-2 px-3 md:w-5/6 lg:max-w-7xl flex flex-row flex-wrap justify-between items-center text-neutral-700 border-t"><div class="text-sm leading-8 flex flex-row flex-wrap justify-start items-center"><div class="h-full text-gray-600">The missing GitHub star history graph</div><a class="h-full flex flex-row justify-center items-center ml-3 text-lg hover:opacity-80" href="https://twitter.com/StarHistoryHQ" target="_blank" rel="noopener noreferrer"><svg stroke="currentColor" fill="currentColor" stroke-width="0" viewBox="0 0 512 512" height="1em" width="1em" xmlns="http://www.w3.org/2000/svg"><path d="M459.37 151.716c.325 4.548.325 9.097.325 13.645 0 138.72-105.583 298.558-298.558 298.558-59.452 0-114.68-17.219-161.137-47.106 8.447.974 16.568 1.299 25.34 1.299 49.055 0 94.213-16.568 130.274-44.832-46.132-.975-84.792-31.188-98.112-72.772 6.498.974 12.995 1.624 19.818 1.624 9.421 0 18.843-1.3 27.614-3.573-48.081-9.747-84.143-51.98-84.143-102.985v-1.299c13.969 7.797 30.214 12.67 47.431 13.319-28.264-18.843-46.781-51.005-46.781-87.391 0-19.492 5.197-37.36 14.294-52.954 51.655 63.675 129.3 105.258 216.365 109.807-1.624-7.797-2.599-15.918-2.599-24.04 0-57.828 46.782-104.934 104.934-104.934 30.213 0 57.502 12.67 76.67 33.137 23.715-4.548 46.456-13.32 66.599-25.34-7.798 24.366-24.366 44.833-46.132 57.827 21.117-2.273 41.584-8.122 60.426-16.243-14.292 20.791-32.161 39.308-52.628 54.253z"></path></svg></a><a class="h-full flex flex-row justify-center items-center mx-3 text-lg hover:opacity-80" href="mailto:star@bytebase.com" target="_blank" rel="noopener noreferrer"><svg stroke="currentColor" fill="currentColor" stroke-width="0" viewBox="0 0 512 512" height="1em" width="1em" xmlns="http://www.w3.org/2000/svg"><path d="M502.3 190.8c3.9-3.1 9.7-.2 9.7 4.7V400c0 26.5-21.5 48-48 48H48c-26.5 0-48-21.5-48-48V195.6c0-5 5.7-7.8 9.7-4.7 22.4 17.4 52.1 39.5 154.1 113.6 21.1 15.4 56.7 47.8 92.2 47.6 35.7.3 72-32.8 92.3-47.6 102-74.1 131.6-96.3 154-113.7zM256 320c23.2.4 56.6-29.2 73.4-41.4 132.7-96.3 142.8-104.7 173.4-128.7 5.8-4.5 9.2-11.5 9.2-18.9v-19c0-26.5-21.5-48-48-48H48C21.5 64 0 85.5 0 112v19c0 7.4 3.4 14.3 9.2 18.9 30.6 23.9 40.7 32.4 173.4 128.7 16.8 12.2 50.2 41.8 73.4 41.4z"></path></svg></a><a class="h-full flex flex-row justify-center items-center mr-3 text-lg hover:opacity-80" href="https://github.com/star-history/star-history" target="_blank" rel="noopener noreferrer"><svg stroke="currentColor" fill="currentColor" stroke-width="0" viewBox="0 0 496 512" height="1em" width="1em" xmlns="http://www.w3.org/2000/svg"><path d="M165.9 397.4c0 2-2.3 3.6-5.2 3.6-3.3.3-5.6-1.3-5.6-3.6 0-2 2.3-3.6 5.2-3.6 3-.3 5.6 1.3 5.6 3.6zm-31.1-4.5c-.7 2 1.3 4.3 4.3 4.9 2.6 1 5.6 0 6.2-2s-1.3-4.3-4.3-5.2c-2.6-.7-5.5.3-6.2 2.3zm44.2-1.7c-2.9.7-4.9 2.6-4.6 4.9.3 2 2.9 3.3 5.9 2.6 2.9-.7 4.9-2.6 4.6-4.6-.3-1.9-3-3.2-5.9-2.9zM244.8 8C106.1 8 0 113.3 0 252c0 110.9 69.8 205.8 169.5 239.2 12.8 2.3 17.3-5.6 17.3-12.1 0-6.2-.3-40.4-.3-61.4 0 0-70 15-84.7-29.8 0 0-11.4-29.1-27.8-36.6 0 0-22.9-15.7 1.6-15.4 0 0 24.9 2 38.6 25.8 21.9 38.6 58.6 27.5 72.9 20.9 2.3-16 8.8-27.1 16-33.7-55.9-6.2-112.3-14.3-112.3-110.5 0-27.5 7.6-41.3 23.6-58.9-2.6-6.5-11.1-33.3 2.6-67.9 20.9-6.5 69 27 69 27 20-5.6 41.5-8.5 62.8-8.5s42.8 2.9 62.8 8.5c0 0 48.1-33.6 69-27 13.7 34.7 5.2 61.4 2.6 67.9 16 17.7 25.8 31.5 25.8 58.9 0 96.5-58.9 104.2-114.8 110.5 9.2 7.9 17 22.9 17 46.4 0 33.7-.3 75.4-.3 83.6 0 6.5 4.6 14.4 17.3 12.1C428.2 457.8 496 362.9 496 252 496 113.3 383.5 8 244.8 8zM97.2 352.9c-1.3 1-1 3.3.7 5.2 1.6 1.6 3.9 2.3 5.2 1 1.3-1 1-3.3-.7-5.2-1.6-1.6-3.9-2.3-5.2-1zm-10.8-8.1c-.7 1.3.3 2.9 2.3 3.9 1.6 1 3.6.7 4.3-.7.7-1.3-.3-2.9-2.3-3.9-2-.6-3.6-.3-4.3.7zm32.4 35.6c-1.6 1.3-1 4.3 1.3 6.2 2.3 2.3 5.2 2.6 6.5 1 1.3-1.3.7-4.3-1.3-6.2-2.2-2.3-5.2-2.6-6.5-1zm-11.4-14.7c-1.6 1-1.6 3.6 0 5.9 1.6 2.3 4.3 3.3 5.6 2.3 1.6-1.3 1.6-3.9 0-6.2-1.4-2.3-4-3.3-5.6-2z"></path></svg></a></div><div class="flex flex-row flex-wrap items-center space-x-4"><div class="flex flex-row text-sm leading-8 underline text-blue-700 hover:opacity-80"><img class="h-6 mt-1 mr-2" src="/assets/sqlchat.webp" alt="SQL Chat"/><a href="https://sqlchat.ai" target="_blank" rel="noopener noreferrer"> SQL Chat </a></div><div class="flex flex-row text-sm leading-8 underline text-blue-700 hover:opacity-80"><img class="h-6 mt-1 mr-2" src="/assets/dbcost.webp" alt="DB Cost"/><a href="https://dbcost.com" target="_blank" rel="noopener noreferrer">DB Cost</a></div></div><div class="text-xs leading-8 flex flex-row flex-nowrap justify-end items-center"><span class="text-gray-600">Maintained by <a class="text-blue-500 font-bold hover:opacity-80" href="https://bytebase.com" target="_blank" rel="noopener noreferrer">Bytebase</a>, originally built by <a class="bg-blue-400 text-white p-1 pl-2 pr-2 rounded-l-2xl rounded-r-2xl hover:opacity-80" href="https://twitter.com/tim_qian" target="_blank" rel="noopener noreferrer">@tim_qian</a></span></div></div></footer><div class="fixed right-0 top-32 hidden lg:flex flex-col justify-start items-start transition-all bg-white w-48 xl:w-56 p-2 z-10 "><div class="w-full flex justify-between items-center mb-2"><p class="text-xs text-gray-400">Sponsors (random order)</p><svg stroke="currentColor" fill="currentColor" stroke-width="0" viewBox="0 0 352 512" class="fas fa-times text-xs text-gray-400 cursor-pointer hover:text-gray-500" height="1em" width="1em" xmlns="http://www.w3.org/2000/svg"><path d="M242.72 256l100.07-100.07c12.28-12.28 12.28-32.19 0-44.48l-22.24-22.24c-12.28-12.28-32.19-12.28-44.48 0L176 189.28 75.93 89.21c-12.28-12.28-32.19-12.28-44.48 0L9.21 111.45c-12.28 12.28-12.28 32.19 0 44.48L109.28 256 9.21 356.07c-12.28 12.28-12.28 32.19 0 44.48l22.24 22.24c12.28 12.28 32.2 12.28 44.48 0L176 322.72l100.07 100.07c12.28 12.28 32.2 12.28 44.48 0l22.24-22.24c12.28-12.28 12.28-32.19 0-44.48L242.72 256z"></path></svg></div><a href="https://bytebase.com?utm_source=star-history" class="bg-gray-50 p-2 rounded w-full flex flex-col justify-center items-center mb-2 text-zinc-600 hover:opacity-80 hover:text-blue-600 hover:underline" target="_blank"><img class="w-auto max-w-full" src="/assets/sponsors/bytebase/logo.webp" alt="Bytebase"/><span class="text-xs mt-2">Bytebase: Database DevOps and CI/CD for MySQL, PG, Oracle, SQL Server, Snowflake, ClickHouse, Mongo, Redis</span></a><a href="https://dify.ai/?utm_source=star-history" class="bg-gray-50 p-2 rounded w-full flex flex-col justify-center items-center mb-2 text-zinc-600 hover:opacity-80 hover:text-blue-600 hover:underline" target="_blank"><img class="w-auto max-w-full" src="/assets/sponsors/dify/logo.webp" alt="Dify"/><span class="text-xs mt-2">Dify: Open-source platform for building LLM apps, from agents to AI workflows.</span></a><a href="mailto:star@bytebase.com?subject=I'm interested in sponsoring star-history.com" target="_blank" class="w-full p-2 text-center bg-gray-50 text-xs leading-6 text-gray-400 rounded hover:underline hover:text-blue-600">Your logo</a></div></div></div><script id="__NEXT_DATA__" type="application/json" crossorigin="">{"props":{"pageProps":{"blog":{"title":"Star History Open Source Best of 2022 | Data, Infra \u0026 DevTools","slug":"star-history-yearly-pick-2022-data-infra-devtools","author":"Mila","featured":true,"featureImage":"/assets/blog/yearly-pick-data-infra-devtools-2022/yearly-pick-data-infra-devtools-2022.webp","publishedDate":"2023-01-11T09:50:06.000Z","excerpt":"Following up on the previous roundup of top front-end os projects, Star History looks at some of the lesser known open-source projects under the category of data/infra/tools in 2022.","readingTime":7},"parsedBlogHTML":"\u003cp\u003eFollowing up on our previous roundup of \u003ca href=\"/blog/star-history-yearly-pick-2022-frontend\"\u003eTop Front-end open-source projects in 2022\u003c/a\u003e, Star History will round up the open-source projects that stood out in the \u003cstrong\u003eData, Infra, and DevTools\u003c/strong\u003e section in 2022.\u003c/p\u003e\n\u003cp\u003eIf you didn’t know, \u003ca href=\"/\"\u003estar-history.com\u003c/a\u003e is a place to view and compare the star history of GitHub repos. We are proud to say that it is the de facto place people turn to for GitHub stars: it is, after all, the first (and second) result on Google. 😆\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/google-result.webp\" alt=\"google-result\"\u003e\u003c/p\u003e\n\u003cp\u003e*Note: the list is in alphabetical order.\u003c/p\u003e\n\u003ch2\u003eBuf\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/buf.webp\" alt=\"buf\"\u003e\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://github.com/bufbuild/buf\"\u003eBuf\u003c/a\u003e is a very low-profile company based in Toronto that focuses on improving the developer experience with Protocol Buffers. Their mission is to deprecate REST/JSON and move the industry towards a schema-driven development model with Protobuf. Their products the Buf CLI and Buf Schema Registry help engineers shift most of their time and effort from managing Protobuf files to implementing features and working on their infrastructure.\u003c/p\u003e\n\u003cp\u003eBuf closed a $68M Series B at the end of 2021 and has kept a low profile for all four rounds of funding, with \u003ca href=\"https://buf.build/blog/an-update-on-our-fundraising\"\u003ethe only official statement\u003c/a\u003e says that they want people to focus on the API and Protobuf ecosystem, rather than how the company is financing the journey (alas, funding is still a big part of the journey).\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/buf-site.webp\" alt=\"buf-site\"\u003e\u003c/p\u003e\n\u003ch2\u003eBytebase\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/bytebase.webp\" alt=\"bytebase\"\u003e\u003c/p\u003e\n\u003cp\u003eWhile the aforementioned Buf targets the API schema, \u003ca href=\"https://github.com/bytebase/bytebase\"\u003eBytebase\u003c/a\u003e targets the database schema hidden behind the API. While there are a number of commercial/open-source database engines on the market, there are only a few tools around to ensure reliable database schema changes. To this day, many engineering teams continue to connect directly to production databases to change data. 💥\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003eLike how GitHub/GitLab manages code changes, Bytebase provides a GUI to manage database changes.\u003c/li\u003e\n\u003cli\u003eLike Figma for designer team collaboration, Bytebase helps DevOps teams collaborate on database management.\u003c/li\u003e\n\u003cli\u003eLike how Terraform defines Infrastructure-as-Code, Bytebase aims to build Database-as-Code.\u003c/li\u003e\n\u003c/ul\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/bytebase-site.webp\" alt=\"bytebase-site\"\u003e\u003c/p\u003e\n\u003cp\u003eBytebase is a Database CI/CD tool (Database-as-Code) for DevOps teams, built for developers and DBAs, and the first (and at the time of this post, only) \u003ca href=\"https://www.bytebase.com/blog/cncf-landscape\"\u003eDatabase CI/CD solution to be included in the CNCF Landscape\u003c/a\u003e.\u003c/p\u003e\n\u003cp\u003eThe mascots Byte and Base (originated from Bytebase\u0026#39;s B, and the shape of a database, respectively) are also adorable.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/byte-base.gif\" alt=\"byte-base\"\u003e\u003c/p\u003e\n\u003ch2\u003eCasdoor\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/casdoor.webp\" alt=\"casdoor\"\u003e\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://github.com/casdoor/casdoor\"\u003eCasdoor\u003c/a\u003e is a centralized authentication / SSO platform based on OAuth 2.0 / OIDC. Casdoor is responsible for authentication, but it can also be integrated with \u003ca href=\"https://github.com/casbin/casbin\"\u003eCasbin\u003c/a\u003e, which is responsible for authorization.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/casdoor-authentication.webp\" alt=\"casdoor-authentication\"\u003e\u003c/p\u003e\n\u003ch2\u003eDagger\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/dagger.webp\" alt=\"dagger\"\u003e\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://github.com/dagger/dagger\"\u003eDagger\u003c/a\u003e is a new offering from Docker founder Solomon Hykes: a portable devkit for CI/CD pipelines. Along with the \u003ca href=\"https://dagger.io/blog/public-launch-announcement\"\u003epublic launch announcement\u003c/a\u003e, Solomon also announced that Dagger has received $20M in \u003ca href=\"https://dagger.io/blog/series-a\"\u003eSeries A\u003c/a\u003e funding.\u003c/p\u003e\n\u003cp\u003eWith pipelines configured differently across platforms, engineering teams struggle to cobble together all the pipelines that are difficult to scale or migrate to other cloud platforms, which not only doesn\u0026#39;t save labor or time, but makes the deployment painful. DevOps engineers using Dagger can define their pipeline, put together the pieces (think Lego), and implement them all in code that will work on any cloud.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/dagger-architecture.webp\" alt=\"dagger-architecture\"\u003e\u003c/p\u003e\n\u003cp\u003eBTW: loving the western + docker vibe here. 🤠⚓️\u003c/p\u003e\n\u003ch2\u003eDuckDB\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/duckdb.webp\" alt=\"duckdb\"\u003e\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://github.com/duckdb/duckdb\"\u003eDuckDB\u003c/a\u003e is similar in architecture to SQLite in that it is also an embeddable database. The difference is that SQLite focuses on OLTP transactions, while DuckDB aims to be its counterpart for OLAP transactions.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/duckdb-dbms.webp\" alt=\"duckdb-dbms\"\u003e\u003c/p\u003e\n\u003cp\u003eMotherDuck, which recently announced \u003ca href=\"https://motherduck.com/blog/announcing-series-seed-and-a/\"\u003e$47.5M Series A funding\u003c/a\u003e, is based on DuckDB.\u003c/p\u003e\n\u003ch2\u003eMeltano\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/meltano.webp\" alt=\"meltano\"\u003e\u003c/p\u003e\n\u003cp\u003eCreated at GitLab in 2018, \u003ca href=\"https://github.com/meltano/meltano\"\u003eMeltano\u003c/a\u003e was initially built for GitLab\u0026#39;s data and analytics teams. It is a data platform for the DataOps era, designed to help data teams assemble various products on the data platform and manage the entire lifecycle, allowing for version control, code review, continuous integration and deployment (CI/CD), and containerization.\u003c/p\u003e\n\u003cp\u003eIt became \u003ca href=\"https://about.gitlab.com/press/releases/2021-06-30-meltano-spins-out-of-gitlab-raises-seed-funding-led-by-gv.html\"\u003ea separate startup\u003c/a\u003e from GitLab in 2021. The source code was initially hosted in GitLab, but \u003ca href=\"https://meltano.com/blog/why-meltano-is-moving-to-github/\"\u003emigrated from GitLab to GitHub\u003c/a\u003e in mid-2022, and soon after, it also raised a $12.4M seed round and launched Meltano 2.0 (2022 was a big year for them).\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/meltano-workflow.webp\" alt=\"meltano-workflow\"\u003e\u003c/p\u003e\n\u003ch2\u003eNeon\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/neon.webp\" alt=\"neon\"\u003e\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://github.com/neondatabase/neon\"\u003eNeon\u003c/a\u003e is a startup that offers serverless Postgres databases for developers and has received $30M in \u003ca href=\"https://neon.tech/blog/funding-a1/\"\u003eSeries A-1\u003c/a\u003e funding. Besides their product, the visuals the team has come up with is really eye-catching: the cute Postgres elephant becomes a real elephant.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/neon-visuals.webp\" alt=\"neon-visuals\"\u003e\u003c/p\u003e\n\u003cp\u003eNeon CEO Nikita Shamgunov was an engineer at Microsoft SQL Server and Meta before founding SingleStore. In 2021, he founded Neon with Heikki Linnakangas (previously a Postgres hacker) and Stas Kelvich (previously on the Yandex database team).\u003c/p\u003e\n\u003cp\u003eThey realized that Postgres could be cheaper and more efficient in the cloud by separating storage and compute. As their tagline suggests, Neon is a serverless Postgres built for the cloud. Compute nodes are activated only when a connection comes in and are automatically shut down during periods of inactivity. Regarding storage, cold data can be offloaded to S3 to save costs.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/neon-architecture.webp\" alt=\"neon-architecture\"\u003e\u003c/p\u003e\n\u003cp\u003eIn addition to serverless, another big part of Neon is its focus on the developer workflow. They recently introduced \u003ca href=\"https://neon.tech/docs/introduction/branching/\"\u003eBranching\u003c/a\u003e, and you can branch your data in the same way you branch your code.\u003c/p\u003e\n\u003ch2\u003eOpa\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/opa.webp\" alt=\"opa\"\u003e\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://github.com/open-policy-agent/opa\"\u003eOpen Policy Agent (OPA)\u003c/a\u003e is a full-featured policy engine designed to separate policy decisions from software and unify policy enforcement across different platforms and systems. Notably, it is a CNCF incubated (\u003ca href=\"https://www.cncf.io/announcements/2021/02/04/cloud-native-computing-foundation-announces-open-policy-agent-graduation/\"\u003egraduated in 2021\u003c/a\u003e) project.\u003c/p\u003e\n\u003cp\u003eOPA\u0026#39;s policies are expressed using Rego, a high-level declarative language. Rego makes it easy to define policies and configure policies (Policy-as-Code) as if you were writing code. For example, questions like: Is Bob allowed to make GET requests to \u003ccode\u003e/api/v1/products\u003c/code\u003e? What records does he have permission to view?\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/opa-workflow.webp\" alt=\"opa-workflow\"\u003e\u003c/p\u003e\n\u003cp\u003eOPA\u0026#39;s \u003ca href=\"https://github.com/open-policy-agent/opa/blob/main/ADOPTERS.md\"\u003eAdopter.md\u003c/a\u003e includes a number of big names using OPA in prod: Netflix, Pinterest, T-Mobile, etc. The syntax for policies has yet to be standardized, leading to everyone having to build the same wheels repeatedly, and OPA has the potential to change that.\u003c/p\u003e\n\u003ch2\u003eSteampipe\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/steampipe.webp\" alt=\"steampipe\"\u003e\u003c/p\u003e\n\u003cp\u003eWith \u003ca href=\"https://github.com/turbot/steampipe\"\u003eSteampipe\u003c/a\u003e, you can use SQL to instantly query your cloud services (AWS, Azure, GCP, and more). \u003ca href=\"https://steampipe.io/docs/cloud/overview\"\u003eSteampipe Cloud\u003c/a\u003e, a fully managed SaaS platform for hosting Steampipe instances, was released January, 2022.\u003c/p\u003e\n\u003cp\u003eSteampipe\u0026#39;s star skyrocketed in October, 2022, thanks to landing on the \u003ca href=\"https://news.ycombinator.com/item?id=33034351\"\u003eHacker News\u003c/a\u003e front page.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/steampipe-hn.webp\" alt=\"steampipe-hn\"\u003e\u003c/p\u003e\n\u003ch2\u003eTier\u003c/h2\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/tier.webp\" alt=\"tier\"\u003e\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://github.com/tierrun/tier\"\u003eTier\u003c/a\u003e is a tool to manage pricing and billing workflow for your SaaS offering\u003c/p\u003e\n\u003cp\u003eTier landed on \u003ca href=\"https://news.ycombinator.com/item?id=33429972\"\u003eHacker News front page\u003c/a\u003e, and their stars skyrocketed, just like Steampipe.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/tier-hn.webp\" alt=\"tier-hn\"\u003e\u003c/p\u003e\n\u003cp\u003ePricing SaaS products is a constant WIP, but it is a complex task and is often tied up in complex workflows and hidden cross-organizational dependencies. Many startups choose a pricing strategy for their product once, which stays the same forever.\u003c/p\u003e\n\u003cp\u003eTier has a top-level design for how to implement pricing that allows for changes to pricing models without changing application code or business processes (Pricing as Code). The founding team thoroughly thought about pricing and built a website explaining t\u003ca href=\"https://priceops.org/\"\u003ehe 5 Pillars of PriceOps\u003c/a\u003e.\u003c/p\u003e\n\u003cp\u003e\u003cimg src=\"/assets/blog/yearly-pick-data-infra-devtools-2022/tier-priceops.webp\" alt=\"tier-priceops\"\u003e\u003c/p\u003e\n\u003cp\u003eFor Star History, our goal is to discover interesting and inspiring projects. The aforementioned projects are not household names in the open-source community (yet), but each has great potential since they are tackling genuine issues with novel ideas. We see that the \u003cstrong\u003eData \u0026amp; Infra \u0026amp; DevTools\u003c/strong\u003e section can be divided into two main categories:\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003eVertical innovation: database engines being the most popular segment, such as DuckDB and Neon.\u003c/li\u003e\n\u003cli\u003eHorizontal unification and standardization:\u003cul\u003e\n\u003cli\u003eBuf for API development.\u003c/li\u003e\n\u003cli\u003eBytebase for database development.\u003c/li\u003e\n\u003cli\u003eCasdoor for authentication sources.\u003c/li\u003e\n\u003cli\u003eDagger for pipeline deployments.\u003c/li\u003e\n\u003cli\u003eMeltano for data platforms.\u003c/li\u003e\n\u003cli\u003eOpa for policy configurations.\u003c/li\u003e\n\u003cli\u003eSteampipe for accessing cloud resources across different cloud providers.\u003c/li\u003e\n\u003cli\u003eTier for SaaS pricing infrastructure.\u003c/li\u003e\n\u003c/ul\u003e\n\u003c/li\u003e\n\u003c/ul\u003e\n\u003cp\u003eWe are sure these projects will perform in the coming years and we can’t wait to see what’s next for them.\u003c/p\u003e\n\u003chr\u003e\n\u003cp\u003eThis is part of Star History Open Source 2022 series, you can continue with:\u003c/p\u003e\n\u003col\u003e\n\u003cli\u003e\u003ca href=\"/blog/star-history-yearly-pick-2022-frontend\"\u003eOpen Source Best of 2022 - Front-end\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"/blog/star-history-open-source-2022-platform-engineering\"\u003eOpen Source Best of 2022 - Platform Engineering\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"/blog/star-history-open-source-2022-open-source-alternatives\"\u003eOpen Source Best of 2022 - Open-Source Alternatives\u003c/a\u003e\u003c/li\u003e\n\u003c/ol\u003e\n"},"__N_SSG":true},"page":"/blog/[slug]","query":{"slug":"star-history-yearly-pick-2022-data-infra-devtools"},"buildId":"No_9KKRmcmQTzlR6_xY3n","isFallback":false,"gsp":true,"scriptLoader":[]}</script></body></html>