Visualizing the Decentralized Web

Jim Pick

Vancouver, Canada

Open Source

Starting in 1990s...

  • Debian
  • Linux Kernel
  • Open Source Java

Career

  • Mix of startups and consulting
  • California and Canada
  • Client work: many websites and apps

Joyent

2009-2011

  • Ryan Dahl (creator of Node.js)
  • Isaac Schlueter (creator of npm)

Freelancing

2017-2018

Focus on "decentralized web"

Client Projects

2018

Ink & Switch

  • San Francisco
  • original founders of Heroku

Ink & Switch

Martin Kleppman, University of Cambridge

O'Reilly - Designing Data-Intensive Applications

Automerge CRDT

Ink & Switch

PixelPusher

  • pixel art editor
  • collaborative
  • Dat + Automerge CRDT

Dat Project

(with @mafintosh)

  • Demo: Dat Shopping List
  • "multiwriter" command line

Protocol Labs

  • IPFS
  • "Dynamic Data"
  • peerpad.net
  • Delta CRDTs

Visualizations

  • Web 1998
  • Web 2018
  • WebTorrent
  • Dat
  • IPFS

Web Publishing

Let's publish this GIF...

Dog GIF

Web 1998

Let's go back in time...

Wayback

Web 1998

  • Physical hardware
Wayback

Web 1998

  • Physical hardware
  • NCSA httpd

Web 1998

  • Physical hardware
  • NCSA httpd
  • HTML
<html>
  <head><title>Sheldon</title><head>
  <body>
  <h1>My Dog</h1>
  <img src="dog.gif">
</html>

Web 1998

  • Physical hardware
  • NCSA httpd
  • HTML
  • FTP

Web 1998

  • Physical hardware
  • NCSA httpd
  • HTML
  • FTP
  • Netscape

Web 1998 Traceroute

Web 2018

Web 2018

HTML is the same!

<html>
  <head><title>Sheldon</title><head>
  <body>
  <h1>My Dog</h1>
  <img src="dog.gif">
</html>

Web 2018

What has changed?

  • Cloud Services (eg. AWS, Azure)
  • CDNs (Akamai, Cloudflare, CloudFront)
  • Chrome, Safari, Edge, Firefox
  • SSL, Let's Encrypt

CDN

CDN = Content Distribution Network

"The Edge"

CDN

CDN

Web 2018 Traceroute (CDN)

WebTorrent

WebTorrent

Based on BitTorrent

Visualization

WebTorrent

Works on the web, based on WebRTC

Dat

  • designed for sharing science data
  • non-profit
  • similar to BitTorrent
  • can update data

Dat Demo: Neuroscience

"Schwann cell‐specific deletion of the endosomal PI 3‐kinase Vps34 leads to delayed radial sorting of axons, arrested myelination, and abnormal ErbB2‐ErbB3 tyrosine kinase signaling"

Beaker Browser

Dat Swarm

Dat for Data Preservation

Institutions can work together

  • California Digital Library
  • Internet Archive
  • Dat Project

IPFS

  • content addressability
  • de-duplication
  • Protocol Labs

IPFS Demo: Art Galleries

Art Gallery: Vancouver

Art Gallery: Tokyo

Secure Scuttlebutt

Secure Scuttlebutt

  • social network
  • each person has an append-only feed
  • works offline
  • "pubs"

Patchwork

Manyverse

Android

It is still early days for the decentralized web.

Try it out!

ありがとう!!

@jimpick