See all as stories in techtok.today

Today's Picks🍒

• 🏆 The code to Nobel-awarding AI, Gartner’s power shortage prediction, The deep learning boom

• 🤖 From Reddit Engineering: A Metadata Store that Handles 100k Reads per Second

🌟 GitHub's Trending Repositories

• ☁️ Create cloud architecture diagrams

• 🎯 Self-hostable personal AI

• 📊 Data engineer handbook

🔥 Products of the Week

• 📨 Notion-like email builder

• ⏳ Maximize your vacation time

• 🔮 Design data models visually

• ➕ And much more

🧐 Weekly Picks

Most impactful articles and news of this week on techtok.today

Nobel-winning AlphaFold3 is now open source

AlphaFold3, the AI that rendered it’s developers the 2024 Chemistry Nobel Prize, is now open source (see the code here). Developed by Google’s DeepMind, this breakthrough tool predicts protein structures interacting with DNA and drugs, paving the way for significant strides in drug discovery. Academic scientists can now download and use its code non-commercially.

More Tech News

Amazon debuts store with everything under $20 

OpenAI to launch Agent tool in January

How a stubborn computer scientist accidentally launched the deep learning boom

Power Shortage To Hit 40% of AI Data Centres by 2027, Gartner Warns

📱 Product Picks

Curated products from Product Hunt.

🔥Trending products of the week

📨 Shootmail

Notion-like email builder. Produces high quality emails with minimal efforts with a growing directory of beautiful, responsive and highly compatible email templates for use cases like product launches, onboarding, authentication, order updates & many more.

🔮 Quorini

Visual tools to design data models, and a fully-managed serverless backend. Focuses in accelerating time-to-market while minimizing resources, without compromising quality.

💡 IndieVoice

Get detailed feedback from other indie hackers. Uses Feedback as a currency, with Weekly feedback competitions and exposure opportunities.

⏳ Stretch My Time Off

An Algorithm to Optimize Your Vacation Days. This website detects your country via IP and leverages government-mandated holidays to maximize your time off. It optimizes vacation scheduling by filling the shortest gaps first, seeking the most extended breaks.

💼 Agree.com

AI-powered collaborative contract signing and invoicing. Renders all the content from any contract enabling a fully editable and collaborative e-signature platform, with invoice generation and secure process payments.

👩🏽‍💻 Engineering Blogs

Articles from engineering blogs related to big tech

How Reddit Built a Metadata Store that Handles 100k Reads per Second

The Problem

By 2024, Reddit's monthly active users tripled from 430 million in 2019 to 1.2 billion, straining their  infrastructure.

• They needed a unified system to handle 50 terabytes of data by 2030, while also accommodating lower-frequency write operations with higher latency.

• They had scattered metadata systems,  so managing and accessing crucial metadata—like video thumbnails and image resolutions— was complicated and inefficient.

The Solution

Reddit's engineering team designed a new, scalable system with a few strategies:

• Data Partitioning: Data was migrated to Sharded Postgress and distributed across shards to balance read loads, preventing bottlenecks and enabling seamless scaling.

• Data Denormalization: Metadata fields needed for image posts were combined into a single JSONB field. This streamlined reads by reducing complex queries.

The Results

The new system successfully handled 100,000 reads per second with sub-50 ms latency, supporting Reddit's growth and ensuring future scalability.

Quick Note

Help us reaching more people and get your shout-out in our newsletter 🤩!

Copy and share your unique referral link:
{{rp_refer_url}}

✨ "Too long don't README"

GitHub trending repos of today

mingrammer/diagrams

Diagrams is a Python library for creating cloud architecture diagrams, supporting AWS, Azure, and GCP. It uses Graphviz to render diagrams for cloud, on-premises, SaaS, and programming frameworks.

What can you use this for? Prototype, visualize systems, track changes, and integrate with Apache Airflow.

khoj-ai/khoj

Khoj is a self-hostable personal AI that interacts with language models, searches documents (images, PDFs), and creates custom agents for various tasks. It’s available via web, mobile, or as an integration with existing tools.

 What can you use this for? Boost productivity, make an agent to document your projects, and learn faster by creating a custom library

Repos to learn something new  

DataExpert-io/data-engineer-handbook

A comprehensive resource for data engineering, featuring books, communities, company directories, blogs, and YouTube channels to help aspiring data engineers. It covers orchestration, data lakes, warehousing, and more.

What can you use this for? Learn data engineering, network in communities and explore new resources