Package gorilla/mux is a powerful HTTP router and URL matcher for building Go web servers with 🦍 - gorilla/mux

I had long been aware of the [effort of cznic](https://gitlab.com/cznic/sqlite) to automatically translate the C source of SQLite to Go while avoiding the complexity CGo would introduce. SQLite was always meant to be a database you embed into your application, and I was curious what tradeoffs that meant, if any, and just generally how it differed from the usual suspects (PostgreSQL, etc.). To explore these trade-offs and differences, I decided to dive deeper into the usage of this library. SQLite is a single-writer multiple-reader database. Using just a single instance of database/sql.DB will not work well with this, because it will make it hard to avoid receiving SQLITE_BUSY errors when multiple writers try to run at the same time (because sql.DB is a connection pool). So we will need to separate readers from writers by making two instances of database/sql.DB and limiting the writer to a single [MaxOpenConn](https://pkg.go.dev/database/sql#DB.SetMaxOpenConns) and the reader to as many as you require. So far, SQLite is behaving remarkably like other databases apart from the single-writer gotcha; we still have connections and per-connection settings. The usual way to pass these settings is usually in the DSN you pass to [sql.Open](https://pkg.go.dev/database/sql#Open) and this is [definitely possible](https://pkg.go.dev/modernc.org/sqlite#Driver.Open), but I find that it would be more straightforward if I could just run my custom SQL when a new connection is made[1]. We can do that with [sqlite.RegisterConnectionHook](https://pkg.go.dev/modernc.org/sqlite#RegisterConnectionHook). Now the question is what settings to use, because [there are quite a few of them](https://www.sqlite.org/pragma.html). These are the ones I am using personally: - `PRAGMA journal_mode = WAL;` Use write-ahead-logging. Better concurrency, but with an edge-case: with heavy writers, the wal can grow idefinitely ([see for more](https://www.sqlite.org/cgi/src/doc/wal2/doc/wal2.md)). I don't expect this will happen in my use-case. For a good description on the various jornal modes, [see this blogpost](https://www.mycelial.com/learn/sqlite-journal-mode-options). - `PRAGMA synchronous = NORMAL;` Since with the WAL journal mode, this is safe, there is no reason to use FULL. - `PRAGMA temp_store = MEMORY;` Let's store temporary indices, tables, etc. in memory, my use-case is not very resource-constrained to require using the filesystem (also, [this is a fun read](https://www.sqlite.org/fasterthanfs.html) if we are talking about additional syscalls to the kernel) - `PRAGMA mmap_size = 30000000000; -- 30GB` Just making sure, access to my database is always done with memory-mapped I/O. - `PRAGMA busy_timeout = 5000;` How much time to wait in milliseconds after which SQLITE_BUSY is returned when waiting for the db to unlock. - `PRAGMA automatic_index = true;` Make sure [automatic indexing](https://www.sqlite.org/optoverview.html#autoindex) is enabled, it can only help, and is a great way to get warnings about indexes that should be created. - `PRAGMA foreign_keys = ON;` Make sure foreign key enforcement is enabled. - `PRAGMA analysis_limit = 1000;` Make sure [ANALYZE](https://www.sqlite.org/lang_analyze.html#approx) returns quickly in case the DB gets large. - `PRAGMA trusted_schema = OFF;` No idea what security audited functions are, but this setting makes sure only those can be run. The manual page tells me to turn it off anyway, so let's do that. Not all of these settings are per-connection settings, but it doesn't hurt to always run all of these on every connection, and having a single "Init SQL" makes things simpler. Let's deal with explicit transactions next. The default transaction mode is DEFERRED, meaning that it depends on the next statement what type of transaction is started (if a SELECT statement comes first, a read transaction is started, with the possibility of upgrading it to a write transaction depending on the statements that follow). With our setup, there should never be multiple writers concurrently, so making all transactions write transactions from the get-go (with BEGIN IMMEDIATE) can only help us show if this invariant is violated. Putting this all together, this is the code we arrive at: ```go package main import ( "bytes" "context" "crypto/sha1" "database/sql" "database/sql/driver" "encoding/hex" "fmt" "time" "modernc.org/sqlite" ) type DB struct { dbPath string Read *sql.DB Write *sql.DB } const initSQL = ` PRAGMA journal_mode = WAL; PRAGMA synchronous = NORMAL; PRAGMA temp_store = MEMORY; PRAGMA mmap_size = 30000000000; -- 30GB PRAGMA busy_timeout = 5000; PRAGMA automatic_index = true; PRAGMA foreign_keys = ON; PRAGMA analysis_limit = 1000; PRAGMA trusted_schema = OFF; ` func New(ctx context.Context, dbPath string) (db *DB, err error) { db = &DB{ dbPath: dbPath, } // make sure every opened connection has the settings we expect sqlite.RegisterConnectionHook(func(conn sqlite.ExecQuerierContext, _ string) error { _, err = conn.ExecContext(ctx, initSQL, nil) return err }) write, err := sql.Open("sqlite", "file:"+db.dbPath) if err != nil { return } // only a single writer ever, no concurrency write.SetMaxOpenConns(1) write.SetConnMaxIdleTime(time.Minute) if err != nil { return } read, err := sql.Open("sqlite", "file:"+db.dbPath) if err != nil { return } // readers can be concurrent read.SetMaxOpenConns(100) read.SetConnMaxIdleTime(time.Minute) db.Read = read db.Write = write return } func (db *DB) InTransaction(ctx context.Context, tx func(context.Context, *sql.Conn) error) (err error) { // cancel anything that takes longer than 5 seconds var cancel func() ctx, cancel = context.WithTimeout(ctx, time.Duration(5*time.Second)) defer cancel() // separate conn thats just for us // so that the transactions queries are executed together conn, err := db.Write.Conn(ctx) if err != nil { return } defer conn.Close() _, err = conn.ExecContext(ctx, "BEGIN IMMEDIATE TRANSACTION") if err != nil { return } defer func() { if r := recover(); r != nil || err != nil { if _, err = conn.ExecContext(ctx, "ROLLBACK"); err != nil { return } } }() err = tx(ctx, conn) if err != nil { return } _, err = conn.ExecContext(ctx, "COMMIT") return } ``` Just as a small added bonus, it's also very easy to register our own go functions that we can then call from SQL. In this example, we define the sha1 function, receiving and returning a single argument, and always returning the same output for the same input (thus the deterministic). For more information, [see the docs](https://www.sqlite.org/appfunc.html) ```go func registerFuncs() { // lets add our own sha1 hash function usable from SQL sqlite.MustRegisterDeterministicScalarFunction( "sha1", 1, func(ctx *sqlite.FunctionContext, args []driver.Value) (driver.Value, error) { var arg *bytes.Buffer switch argTyped := args[0].(type) { case string: arg = bytes.NewBuffer([]byte(argTyped)) case []byte: arg = bytes.NewBuffer(argTyped) default: return nil, fmt.Errorf("expected argument to be a string, got: %T", argTyped) } h := sha1.Sum(arg.Bytes()) return hex.EncodeToString(h), nil }, ) } ``` In conclusion, this solution works perfectly well for most of the usage scenarios out there where immense scaling is neither expected nor needed. There are faster ways to use SQLite with Go (see the [excellent cvilsmeier benchmarks](https://github.com/cvilsmeier/go-sqlite-bench)), but its still plenty-fast enough, and avoiding CGo makes it very convenient also. [1]: This is another thing that database/sql.DB being a connection pool makes harder.

Intel Movidius Myriad X Platform by Luxonis. Contribute to itsderek23/DepthAI development by creating an account on GitHub.

An embedded platform for combining Depth and AI, built around Myriad X

The portal for geek projects of Jason A. Donenfeld, also known as ZX2C4.

Set up locally hosted OCR (On-premise) to allow your documents to be searchable and editable without leaving your own environment.

Agent written in GO that updates assets in a Snipe-IT instance with local data. - azusapacificuniversity/snipe-agent

Agent written in GO that updates assets in a Snipe-IT instance with local data. - azusapacificuniversity/snipe-agent

PyITAgent is a Python-based Windows executable designed to serve as an agent for your computer, allowing it to sync seamlessly with your Snipe-IT asset management system. - booskit-codes/PyITAgent

{{ $description }}

Powerful Open Source Document Management System (DMS) & Enterprise Content Management (ECM) ✓Flexible ✓License-free ✓Reliable since 2003

Papermark is the open-source DocSend alternative with built-in analytics and custom domains. - mfts/papermark

Your All-in-One Learning Portal: GeeksforGeeks is a comprehensive educational platform that empowers learners across domains-spanning computer science and programming, school education, upskilling, commerce, software tools, competitive exams, and more.

The IQUNIX Magi65 is the best-sounding low-profile aluminum keyboard on the market, with VIA support, customizable buttons, volume knob, and ultra-long battery life. Ready to challenge any low-profile keyboard on the market!

Late last year, eight major U.S. telecoms were the victim of a massive intrusion by Chinese hackers who managed to spy on public U.S. officials for more than a year. The “Salt Typhoon” hack was so severe, the intruders spent a year rooting around the ISP networks even after discovery. AT&T and Verizon, two of the compromised companies,…

Abstract page for arXiv paper 2506.13052: Buy it Now, Track Me Later: Attacking User Privacy via Wi-Fi AP Online Auctions

Some thoughts in defense of the often ridiculed Honeywell H316 kitchen computer.

In this blog we will learn about firewalls in GCP

Free to download, The Little Go Book is an introduction to Google's Go programming language

ChatGPT can harm an individual’s critical thinking over time, a study released this month suggests. Researchers at MIT’s Media Lab asked subjects to write several SAT essays and separated sub…

Reinstall your VPS to minimal Debian. Contribute to bohanyang/debi development by creating an account on GitHub.

Modular CJIS Compliance Ruleset for Wazuh A maintainable, version-controlled collection of custom Wazuh rules mapped to CJIS Security Policy controls. Designed for easy auditing, deployment, and integration with SIEM workflows. - TristanGNS/wazuh-cjis-rules

Gin is a HTTP web framework written in Go (Golang). It features a Martini-like API with much better performance -- up to 40 times faster. If you need smashing performance, get yourself some Gin. - gin-gonic/gin

Wherein I record things I wish I'd known earlier

Look no further. This is it.

How I wrote filter rules for YouTube

AtomicOS - A security-first operating system built from scratch. - ipenas-cl/AtomicOs

Nebula Overlay Networks: Extend network access with on-demand, encrypted tunnels between any hosts on any network. Defined Networking is the company behind the Nebula open-source project.

Smart SSH, HTTPS, MySQL and Postgres bastion/PAM that doesn't need additional client-side software - warp-tech/warpgate

Firezone is a fast, flexible VPN replacement built on WireGuard® that eliminates tedious configuration and integrates with your identity provider.

🔥 🔥 🔥 Open Source JIRA, Linear, Monday, and Asana Alternative. Plane helps you track your issues, epics, and cycles the easiest way on the planet. - makeplane/plane

GLPI is a Free Asset and IT Management Software package, Data center management, ITIL Service Desk, licenses tracking and software auditing. - glpi-project/glpi

IT documentation, ticketing and billing for small MSPs

Open source project management software for classic, agile or hybrid project management: task management✓ Gantt charts✓ boards✓ team collaboration✓ time and cost reporting✓ FREE trial!

Kanboard is a free and open source Kanban project management software.

A clever solution to organize and optimise your workspace. Document hideaway to store loose papers and notes. Magnetic cable holder keeps cables in place. Made from premium vegan leather and 100% recycled PET felt. Available in Medium (686 x 373 x 4.9mm) and Large (896 x 423 x 4.9mm).

Powershell API Wrapper for Snipe-it. Contribute to snazy2000/SnipeitPS development by creating an account on GitHub.

Intune to snipe via api. Contribute to brngates98/Intune2snipe development by creating an account on GitHub.

Annie Duke, a poker champion turned decision scientist, talks with Big Think about how to choose well under uncertainty.

✔️ WireGuard-Manager is an innovative tool designed to streamline the deployment and management of WireGuard VPNs. Emphasizing user-friendliness and security, it simplifies the complexities of VPN configuration, offering a robust yet accessible solution for both personal and professional use. - complexorganizations/wireguard-manager

Improve device reliability and offer higher service availability by duplicating parallel power supplies. Understand concepts and corresponding mathetical formaluas

Brian's personal site, opinions are his, nobody elses

The mouse I use daily for many hours is Logitech’s MX Ergo trackball and I generally consider it the best trackball one can currently buy. Unfortunately, after only a year or two of usage, the trackball’s mouse buttons no longer function correctly.

Learn how to do virtual routing and firewalling on OpenBSD using Routing Tables and Routing Domains.

way out of the mess I had gott

Power of Kubernetes, Simplicity of Heroku. Contribute to czhu12/canine development by creating an account on GitHub.

Religious leaders took psilocybin—the compound in magic mushrooms—in a Johns Hopkins and N.Y.U. study. Many are now evangelists for psychedelics. Michael Pollan, the author of “How to Change Your Mind,” reports.

Nightwatch is a monitoring solution for Laravel applications. See how to track and solve issues like slow controllers, failing jobs, and timed-out API endpoints.

A tiling terminal emulator for Linux using GTK+ 3. Contribute to gnunn1/tilix development by creating an account on GitHub.

Terminal Emulators. Contribute to cdleon/awesome-terminals development by creating an account on GitHub.

Irssi is a fabulous IRC client, which runs on the command line. I'm sure I don't use half the features it offers but its very stable, unintrusive ( you can run it in a background terminal, or even leave it running in a detached screen process ), and frankly excellent. Because I don't have to set u

Ərk is an open source, cross-platform IRC client written in Python 3, Qt 5, and Twisted. - nutjob-laboratories/erk

(Originally .) Alacritty now uses TOML formatting for its config files. This is a simple example. There are the specification here: . Bu...

Showing the current time in a tmux pane is a feature that I discovered by accident. Although I’ve got tmux setup to show the current time in the bottom right...