Networking

This article is great intro.
Notes
127.0.0.1 is localhost.
Can go to Network tab to see details about requests and why they failed if they did fail. Can view headers etc
Web browsers will try to connect over port 80 by default.
​Best way to poll REST API? Timer seems fine. If the data is really changing frequently a WebSocket seems more appropriate. If it’s changing infrequently but you wanna know right away, a silent push notification is the “right” way but that requires some infrastructure​
Links
​Stanford CS 144: Introduction to Computer Networking (HN)
​15-441/641 Computer Networks course (2019) (Lectures)
​Clash - Rule based tunnel in Go.
​WebTTY - Share a terminal session over WebRTC.
​libuv - Cross-platform asynchronous I/O.
​Python implementation of the IPv8 layer​
​Mitmproxy - Free and open source interactive HTTPS proxy. (Code) (HN)
​Mitmproxy 7.0 (2021) (HN)
​CFSSL - CloudFlare's PKI/TLS swiss army knife.
​Every Linux networking tool I know​
​inlets - Expose your local endpoints to the Internet. (HN) HN 2​
​Recommended books on Computer Networks? (2019)​
​SwiftNIO - Cross-platform asynchronous event-driven network application framework for rapid development of maintainable high performance protocol servers & clients.
​Wirefilter - Execution engine for Wireshark-like filters.
​Mr.2 - Expose local server to external network.
​High Performance Browser Networking book (2013) (HN)
​stun - Simple layer-3 network tunnel written in C++.
​devcert - Local HTTPS development made easy.
​Open Screen Protocol - Suite of network protocols that allow user agents to implement the Presentation API and the Remote Playback API in an interoperable fashion.
​The world in which IPv6 was a good design (2017) (HN)
​A free Argo Tunnel for your next project (2019)​
​HoneyBadger - Quantum Insert detector/recorder.
​SFTPGo - Full featured and highly configurable SFTP server software.
​ZeroTier - Smart Ethernet Switch for Earth. (Terraform provider)
​ssl-proxy - Simple single-command SSL reverse proxy with autogenerated certificates (LetsEncrypt, self-signed).
​Netdata - Distributed, real-time, performance and health monitoring for systems and applications. (HN)
​OpenDrop - Open Source AirDrop Implementation.
​Apache Traffic Server​
​Mainframer - Tool that executes a command on a remote machine while syncing files back and forth.
​Magma - Platform for building access networks and modular network services.
​Awesome Networking​
​docker-nginx-http3 - Alpine Linux image with Nginx with HTTP/3 (QUIC), TLSv1.3, 0-RTT, brotli support.
​SCION Internet Architecture​
​Everything curl - the book (Code)
​Seastar - High performance server-side application framework. (Web) (Article) (Awesome)
​ServiceTalk - Networking framework that evolves with your application.
​Beginner Network Pentesting course notes​
​Scale By The Bay 2019: Norman Maurer, Netty 5: Lessons Learned​
​Neebula - Scalable overlay networking tool with a focus on performance, simplicity and security. It lets you seamlessly connect computers anywhere in the world.
​gost - Simple tunnel written in golang.
​Braid - Effort to incorporate new distributed technologies into the existing World-Wide Web.
​Implementation of CoAP in go​
​inlets - Expose your local endpoints to the Internet.
​inletsctl - Fast HTTP (L7) and TCP (L4) tunnels written in Go.
​Awesome Computer Networking Resources​
​Zwitterion - Web dev server that lets you import anything.
​warmy - Hot-reloading loadable and reloadable resources.
​OpenLiteSpeed Web Server - High-performance, lightweight, open source HTTP server.
​Inter-Networking (2019)​
​Network Programming Initiative - Supports research on languages, algorithms, and tools for network programming.
​Lobsters: Optimizing home network performance (2020)​
​fbtracert - Identify the network components that drops packets by employing the traceroute logic which explores multiple parallel paths.
​Bandwidth Performance Monitoring with Iperf​
​ToDD - Distributed Network-Service-Level Assertion Engine.
​myLG - Network Diagnostic Tool.
​Zeek - Powerful network analysis framework that is much different from the typical IDS you may know.
​Fuzzowski - Network Protocol Fuzzer that we will want to use.
​naabu - Port scanning tool written in Go that allows you to enumerate valid ports for hosts in a fast and reliable manner.
​sniffglue - Secure multithreaded packet sniffer.
​IPinfo - Trusted Source for IP Address Data.
​Host.io - Comprehensive Domain Data API for Developers.
​Remembering the LAN (2020)​
​sylkie - IPv6 address spoofing with the Neighbor Discovery Protocol.
​FRITZBox - Intelligent Wi-Fi for maximum wireless speed and significantly greater range.
​Home network recommendations? (2020)​
​nmap - Network Mapper.
​How Tailscale works (2020) (HN)
​Beej's Guide to Network Programming: Using Internet Sockets (HN) (Code)
​Unix Network Programming​
​Wireshark - World’s foremost and widely-used network protocol analyzer.
​What resources would you recommend to learn socket programming? (2020)​
​Lobsters: Good resources to learn about computer networking (2020)​
​Introducing KCP: a new low-latency, secure network stack (2020)​
​Layer 2 network neighbourhood discovery tool​
​Nmap Network Scanning docs​
​Reverse Tunneling Dialer - HTTP in TCP in Websockets in HTTP in TCP, Tunnel all the things.
​Lobsters: How do you name your hosts? (2020)​
​libnekit - Efficient and Flexible Network Utility Library.
​R2 - Network packet forwarding engine in Rust.
​packetdrill - Enables quick, precise tests for entire TCP/UDP/IPv4/IPv6 network stacks, from the system call layer down to the NIC hardware.
​TCP/IP Tutorial (1991) (HN)
​Is BGP safe yet? No. (HN)
​Achieveing reliable UDP transmission at 10 Gb/s using BSD socket for data acquisition systems (2017) (HN)
​Networking tutorial (2015)​
​wormhole - Expose your local web server to the internet with a public URL.
​pyshark - Python wrapper for tshark, allowing python packet parsing using wireshark dissectors.
​Guardian Web Application Firewall​
​Network Programming Self-Study (2020)​
​Basic LDAP functionality for Go​
​Don't trust default timeouts (2020) (Lobsters)
​Fastly Varnish - Explaining how the Fastly CDN works.
​IkaGo - Proxy which helps bypassing UDP blocking, UDP QoS and NAT firewall written in Go.
​TURN Server - VoIP media traffic NAT traversal server and gateway. It can be used as a general-purpose network traffic TURN server and gateway, too.
​gortcd - Fast TURN and STUN server: cross-platform, hot reload, flexible config.
​router7 - Pure-Go implementation of a small home internet router.
​socketmaster - Zero-configuration reverse proxy. (Code)
​free5GC - Open source 5G core network base on 3GPP R15.
​How to receive a million packets per second (2015)​
​5G and Shannon’s Law (2020) (HN)
​Erbium - Networking services for small/home networks.
​History of the Finger Protocol (2020) (Lobsters)
​Old box, dumb code, few thousand connections, no big deal (2020) (Lobsters) (HN)
​Fast Subnet Matching (2020)​
​spoof - Easily spoof your MAC address in macOS, Windows, & Linux.
​Circumlunar Space - Confederation of independently administered but tightly interconnected public access unix servers, with a special emphasis on gopher hosting.
​Can we talk about client-side certificates? (2020) (Lobsters)
​How CDNs Generate Certificates (2020)​
​Tunnel to dev - Expose your local web server to the internet with a public URL.
​CS Visualized: CORS (2020)​
​IPv4, IPv6, and a sudden change in attitude (2020) (HN)
​Cloudflare Network Interconnect (2020) (HN)
​Adding a fiber link to my home network (2020) (HN)
​"Cloud-like" Infrastructure at Home - Part 1: LoadBalancers on the Metal (2020)​
​Ask HN: How Belarus can keep connected despite internet blackout? (2020)​
​How NAT traversal works (2020) (Lobsters)
​Peer-to-Peer Communication Across Network Address Translators​
​25 Best CDN Providers​
​How do Routers Work, Really? (2020) (HN)
​Building a better home network (2020) (Lobsters)
​socat (2018) - Socat stands for SOcket CAT. It is a utility for data transfer between two addresses.
​PJON (Padded Jittering Operative Network) - Arduino-compatible, multi-master, multi-media network protocol.
​Fast Software Cache Design for Network Appliances (2020)​
​Creating a Home IPv6 Network (2020)​
​Building the Next Evolution of Cloud Networks at Slack (2020)​
​Gubernator - Distributed, high performance, cloud native and stateless rate limiting service.
​MTProxy - Simple MT-Proto proxy.
​Multicast and the markets with Brian Nigito (2020)​
​NetworKit - Open-source tool suite for high-performance network analysis. Its aim is to provide tools for the analysis of large networks in the size range from thousands to billions of edges. (Web)
​Understanding operational 5G: a first measurement study (2020) (HN)
​slurm - Yet another network load monitor.
​evilscan - Nodejs Simple Network Scanner.
​Ixy languages - High-speed network driver written in C, Rust, C++, Go, C#, Java, OCaml, Haskell, Swift, JavaScript, and Python.
​Redwood - Web content filter that runs as an HTTP proxy.
​Anachro: Network Protocol, and a PC architecture for a microcontroller-based system​
​Cloudflare One (2020) (HN)
​I Setup My Own Personal CDN using Cloudflare and S3 (2020)​
​Mininet - Emulator for rapid prototyping of Software Defined Networks. (Web)
​Project V - Set of network tools that help you to build your own computer network. Secures your network connections and thus protects your privacy.
​BPF, XDP, Packet Filters and UDP (2020) (Tweet)
​Hermes - Minimalist, easy to deploy, dependency free file server written in go.
​CDN Geolocation - Geolocation API via HTTP headers from a CDN, currently supporting AWS Cloudfront, Cloudflare, Fastly and Google AppEngine.
​remotemoe - Software daemon for exposing ad-hoc services to the internet without having to deal with the regular network stuff such as configuring VPNs, changing firewalls, or adding port forwards.
​MOSN - Cloud native proxy for edge or service mesh written in Go.
​File Descriptor Transfer over Unix Domain Sockets (2020)​
​curl - Command line tool and library for transferring data with URLs. (Code)
​IPv6 Is a Nightmare (2020) (HN) (Lobsters)
​Etherify - Transmit Radio Signals via Ethernet. (HN)
​NetworkMananger-l2tp - L2TP and L2TP/IPsec support for NetworkManager.
​GNUnet - Network protocol stack for building secure, distributed, and privacy-preserving applications. (Code)
​Secure Reliable Transport (SRT) Protocol - Open source transport technology that optimizes streaming performance across unpredictable networks, such as the Internet.
​Awesome Optimal Transport​
​Build VNF - Collection of utilities to build fast and green virtualized network functions.
​Argo Tunnel client - Tunneling daemon that proxies any local webserver through the Cloudflare network. (Docs)
​Many services, one cloudflared (2020)​
​Transport Protocols: TCP and UDP​
​PcapPlusPlus - Multiplatform C++ library for capturing, parsing and crafting of network packets.
​LibreSpeed - Free and Open Source Speedtest. (LibreSpeed CLI)
​CppServer - Ultra fast and low latency asynchronous socket server & client C++ library with support TCP, SSL, UDP, HTTP, HTTPS, WebSocket protocols and 10K connections problem solution.
​TinyCheck - Allows you to easily capture network communications from a smartphone or any device which can be associated to a Wi-Fi access point in order to quickly analyze them.
​uSockets - Miniscule cross-platform eventing, networking & crypto for async applications.
​Nanomsg - Socket library that provides several common communication patterns. It aims to make the networking layer fast, scalable, and easy to use. (GitHub)
​Proxify - Swiss Army knife Proxy tool for HTTP/HTTPS traffic capture, manipulation, and replay on the go.
​Messaging Layer Security (MLS) Protocol (Code)
​Messaging Layer Security (MLS) Architecture​
​rosen: censorship-resistant proxy tunnel (2020) (Lobsters)
​Awesome PCAP Tools​
​Networking Tools Every Developer Needs to Know (2020)​
​Babel - Loop-avoiding distance-vector routing protocol for IPv6 and IPv4 with fast convergence properties. (Code)
​Network UPS Tools - Collection of programs which provide a common interface for monitoring and administering UPS, PDU and SCD hardware. (Web)
​ESP-Hosted solution - Provides a way to use ESP32 or ESP32-S2 (termed as ESP peripheral) as a communication processor for Wi-Fi and Bluetooth/BLE connectivity.
​Fun with IP address parsing (2020) (HN) (Lobsters)
​Syntropy Stack - The Future of Programmable Networking.
​The Atlas for the Aspiring Network Scientist (2021) (HN)
​Awesome Tunneling - Ngrok alternatives and other ngrok-like tunneling software and services.
​Server-sent events: a simple way to stream events from a server (2021)​
​Mesh Network Lab - Emulate mobile ad-hoc mesh networks of hundreds of nodes on a computer.
​Connectivity: Wireless & Wired​
​IPv6 ULA (Unique Local Address) registry - Contains all of the prefixes that were in the sixxs database.
​Timing web requests with cURL and Chrome (2018)​
​CoreRAD - Extensible and observable IPv6 Neighbor Discovery Protocol router advertisement daemon. (Web)
​Intro to securing communication protocols with Noise (2021)​
​GoBGP - BGP implementation in Go. (Web)
​DPDK - Set of libraries and drivers for fast packet processing.
​Open Wireless Link - Open Apple Wireless Direct Link (AWDL) implementation written in C. (Web)
​Change your MAC address with a shell script (HN)
​OpenStack Neutron - OpenStack project to provide "network connectivity as a service" between interface devices (e.g., vNICs).
​Thola - Tool for monitoring and provisioning network devices written in Go.
​Tips how to connect with people better​
​Computer Networks: A Systems Approach (HN)
​localtunnel - Allows you to easily share a web service on your local development machine without messing with DNS and firewall settings. (Web)
​Merino - SOCKS5 Proxy server written in Rust.
​Pomerium - Identity-aware proxy that enables secure access to internal applications. (Code)
​Shadowsocks - Secure socks5 proxy. (Code) (GitHub)
​Open, Programmable, and Virtualized 5G Networks​
​The Programmable Data Plane Reading List​
​Ridiculous Router Resets (2021)​
​Curl Cookbook​
​Splitting the ping (2021) (Lobsters) (Code)
​Arkime - Open source, large scale, full packet capturing, indexing, and database system. (Web)
​Implementer's Guide to SOCKS (2021)​
​Open Wireless Link - Opening up Apple’s wireless ecosystem around the Apple Wireless Direct Link (AWDL) protocol.
​Audio over Bluetooth: most detailed information about profiles and codecs (2019) (HN)
​UERANSIM - Open source 5G UE and RAN (gNodeB) implementation.
​netbootd - Lightweight network boot/install server (DHCP, TFTP, HTTP).
​Ethernet and IP Networking 101 (Heavily Illustrated) (2021)​
​The Actual OSI Model (2021) (HN)
​ZeroTier - Connect team members from anywhere in the world on any device.
​hostctl - Gives you more control over the use of your hosts file.
​Lobsters: What do you use for your home networking setup? (2021)​
​ifconfig.co - What is my IP address?
​Network Calculus: A Comprehensive Guide (2016)​
​Networking Books​
​Full functional WiFi repeater (correctly: a WiFi NAT router)​
​Docker Stack which Monitors your home network​
​Why did the IETF specifically choose 192.168/16 to be a private IP address class? (Lobsters)
​Start building your own private network on Cloudflare today (2021)​
​sx - Fast, modern, easy-to-use network scanner.
​Awesome Internet Scanning​
​Termshark - Terminal UI for tshark, inspired by Wireshark.
​netdiag - IPv4 and IPv6 network diagnostics.
​Kentik - Cloud-based, real-time network visibility and analytics solution for network and security operators. (GitHub)
​NoRouter - (IP-over-Stdio) is the easiest multi-host & multi-cloud networking ever. (Code)
​Proving 50-Year-Old Sorting Networks Optimal: Part 1 (2021) (Lobsters)
​innisfree - Expose local services via public IPv4 addresses, safely.
​Transport vs Network (2021)​
​Send My - Upload arbitrary data via Apple's Find My network. (Article) (HN)
​Wait for It - Wait until an address become available.
​Home network 10 Gbit/s upgrade (2021)​
​Observing my cellphone switch towers (2021) (HN)
​Preparing your game for deterministic netcode (2021) (HN)
​BGP introduction, all you need to know to start (2021) (HN)
​FRRouting - Software that implements and manages various IPv4 and IPv6 routing protocols. (Web)
​The long wondrous life of a Tailscale packet (2021)​
​Demo BPF applications - Scaffolding for BPF application development with libbpf and BPF CO-RE.
​BPF tips & tricks: the guide to bpf_trace_printk() and bpf_printk() (2021)​
​Understanding btrfs internals (2020)​
​multiaddr - Composable and future-proof network addresses. (Web)
​curl localhost as a local host (2021)​
​OSI Reference Model - The ISO Model of Architecture for Open Systems Interconnection (1980)​
​Easegress - All-rounder traffic orchestration system.
​Bluetooth Mesh Rust - Cross-platform, full Bluetooth Mesh stack implemented in Rust.
​netkat - Netcat version using raw sockets to avoid iptables and/or other OS filtering mechanisms.
​Enabling real-time collaboration with RSocket (2021)​
​LDAP Guide Part 1: Foundations​
​Ask HN: Best way to learn networking fundamentals quickly (2021)​
​WTF is my IP? (Code)
​Intercepting Zoom's encrypted data with BPF (2020)​
​Lucid: A Language for Control in the Data Plane (2021)​
​LibreCellular - Aims to make it easier to create 4G cellular networks with open source software and low cost software-defined radio (SDR) hardware. (HN)
​What's your preferred tool for load testing? (2021)​
​Ask HN: Good books/courses to learn networking essentials for web developers? (2021)​
​Download speeds: What Do 2G, 3G, 4G and 5G mean? (2018) (HN)
​Tetrate - Application-aware networking for all Workloads, in all Environments. (GitHub)
​Hotwire - Allows you to study network traffic of a few popular protocols in a simple way.
​HomeNetworking Reddit​
​i2pd - End-to-End encrypted and anonymous Internet. (Web)
​Cheat Sheet on Curl Latency Metrics: how to benchmark server latency with curl​
​Channel polarization: A method for constructing capacity-achieving codes for symmetric binary-input memoryless channels (2008) - Paper that inspired 5G. (HN)
​What is Anycast? | How does Anycast work?​
​Comcast - Simulating poor network connections so you can build better systems. (Reddit)
​Introduction to open source private LTE and 5G networks (2021) (HN)
​A Linux Kernel Implementation of the Homa Transport Protocol (2021) (Paper)
​Netcat - All you need to know (2021) (HN)
​Installing A Home Network (2021)​
​IPv6 Watch (HN)
​sockperf - Network Benchmarking Utility.
​The 5-Hour CDN (2021) (HN)
​Rustcat - Netcat Alternative in Rust.
​Nautobot - Network Source of Truth & Network Automation Platform.
​How does FaceTime Work? (2021)​
​phpIPAM - Open-source web IP address management application. (Code)
​What domain name to use for your home network (2021) (HN)
​IPv4 vs. IPv6 FAQ (HN) (Lobsters)
​Latency Sneaks Up on You (2021) (HN)
​Wi-Fi QR Code generator - Create a QR code with your Wi-Fi login details.
​NetworkX - Network Analysis in Python. (Web)
​Forward and reverse proxies explained (2021)​
​How I re–over-engineered my home network for privacy and security (2021) (HN)
​Weird Proxies - Cheat sheet about behavior of various reverse proxies and related attacks.
​Bender - Build load testing applications for services using protocols like HTTP, Thrift, Protocol Buffers and many more.
​Fast IPv4 to Host Lookups (2020)​
​Where are IPv3 and IPv5? (Lobsters)
​If fiber optics are 30% the speed of light, why is ping across countries so high? (2021)​
​slirpnetstack - User-mode networking for unprivileged network namespaces.
​RTC (Real-Time Communication) at scale (2020)​
​Submarine cable map rendered onto a globe (HN)
​gostatsd - Implementation of Etsy's statsd in Go with tags support.
​CloudFlair - Find origin servers of websites behind CloudFlare by using Internet-wide scan data from Censys. (Article)
​alphaicon - α-Indirect Control in Onion-like Networks.
​IPv6 Fundamentals: A Straightforward Approach to Understanding IPv6, 2nd Edition (HN)
​CIDR.xyz - Web-based CIDR / netmask / IP address visualizer. (Code)
​Steering oceans of content to the world (2017) (HN)
​WiFi Connect - Easy WiFi setup for Linux devices from your mobile phone or laptop.
​Hello IPv6: a minimal tutorial for IPv4 users (HN)
​Geneva - Automated censorship evasion for the client-side and server-side. (Web)
​socks - Fully featured SOCKS proxy client supporting SOCKSv4, SOCKSv4a, and SOCKSv5. Includes Bind and Associate functionality.
​go-netflow - Capture process in/out traffic, similar to c Nethogs.
​Preview Local Projects with Cloudflare Tunnel (2021) (Tweet)
​Tunnel: Cloudflare’s Newest Homeowner (2021) (Tweet)
​Characterizing CDNs’ latencies with passive measurement (2021)​
​The Network Simulator - Free open source project aiming to build a discrete-event network simulator targeted for simulation research and education.
​Cuishark - Protocol analyzer like a wireshark on CUI.
​hostsfile - Go tool for working with /etc/hosts files.
​127 - Tool for mapping hostnames to random loopback addresses.
​What's in a hostname? (2021)​
​32 Bit Real Estate (2021) (HN)
​Consul - Service Mesh for any runtime or cloud.
​Consul Replicate - Provides a convenient way to replicate values from one Consul data center to another using the consul-replicate daemon.
​multiping - Pings several hosts at once to test outside connectivity.
​Ethox - Standalone library for user-space networking and unikernel systems with a focus on speeed and stability.
​Netmiko - Multi-vendor library to simplify Paramiko SSH connections to network devices.
​Gomiko - Go implementation of Netmiko.
​hBPF - Extended Berkley Packet Filter (eBPF) CPU written entirely in Python3 for PC and FPGA.
​Comparing Open Source BGP Stacks (2021)​
​Open IP over VHF/UHF 5 (2021) (HN)
​Linux, Netlink, and Go - Part 1: netlink (2017)​
​ZMap - Fast single packet network scanner designed for Internet-wide network surveys. (Web)
​net2o - Reinventing the Internet. (Lobsters)
​Network intersubjectives (2021) (Tweet)
​Viska - SIP server/framework built in Rust.
​libSRTP - Implementation of the Secure Real-time Transport Protocol (SRTP), the Universal Security Transform (UST), and a supporting cryptographic kernel.
​Pathvector - Declarative edge routing platform that automates route optimization and control plane configuration with secure and repeatable routing policy. (Web)
​inlets-on-fly - Automates the task of creating an inlets-pro exit-server (tunnel server) on the fly.io platform.
​Ask HN: Connect to the Internet the old way during next Ethiopian lockdown? (2021)​
​“Illegal” Moscow state university network built by students (2002-2013) (HN)
​