-1+1689 
Journey into Information Theory: The Language of Coins

This epic journey will take us from smoke signals to internet compression and the modern day search for extraterrestrial intelligence. posted on Khan Academy

Lectures
  1. What is Information Theory

    Introduction to the course

  2. Origin of Alphabet

    Explore this origin of pictographic and ideographic writing (proto-writing)

  3. History of the Alphabet

    History of the Alphabet. This video introduces the Hieroglyphic, Cuneiform, Hieratic, Demotic, Phonetician writing systems. It presents information as a series of selections from a finite collection of symbols..

  4. Introduction to Coding Theory

    Introduction to source encoding!

  5. History of Visual Telegraphs

    From signal fires to semaphore lines

  6. Electrostatic Telegraphs

    Explore early telegraph technology using electrostatics

  7. The Battery & Electromagnetism

    The key technology in our story

  8. Morse Code & The Information Age

    Morse Code & The Information Age

  9. Channel Capacity & Baud

    Introduction to Symbols, Signals & Noise

  10. Measuring Information

    Hartley and Nyquist's first attempt to quantify information

  11. Markov Chains

    The origin of Markov Chains

  12. Mathematical Theory of Communication

    Shannon's application of Markov Chains

  13. Entropy

    Introduction to information entropy

  14. Compression Codes

    Huffman coding

Prerequisites

None! Curiosity only...and patience (videos will come out every 2-3 weeks)

Syllabus

Tentative (currently writing this journey)

  • Linguistics (origin of language)
  • History of Alphabet (written language)
  • Media (clay, stone, papyrus, electricity)
  • Origin of Electricity & Magnetism
  • History of Communication (telegraphs)
  • Markov Models
  • Conditional Probability
  • Information Theory (Shannon)
  • Compression
  • Coding
  • Search for Extra Terrestrial Intelligence (information filters)
Additional information

Course begins September 2012 and will run until Summer 2013. Best way to keep up with new stuff is to subscribe here

Teacher qualifications

Studied Information Theory, Mathematics & Computer Science. Faculty member at Khan Academy.

Latest Update
Source Coding (2012-12-06 02:25:16)

"new video up on source coding!"

Roster
1. rogerwilco
2. RaishenC7
3. HiddenFlagon
4. Crimius
5. bamaphdee
6. hotlikearobot
7. zaq12343
8. takamori
9. swoodilypooper
10. Driver1676
11. xaustinx
12. franklintuts
13. Shlldn
14. kyzic
15. sriracha5
16. thaliaschild
17. freewisdom
18. elaufis
19. wuncidunci
20. chngr
21. mooglefrooglian
22. Toepuka
23. zerubroberts
24. eronre12
25. ang
26. Nella
27. PhotonPhighter
28. SoItAlwaysGoes
29. acemonkey18
30. Chanthien
31. bluepickles
32. rdm5181
33. Shadowchai
34. adamimos
35. syzo
36. PalmPaperCut
37. jmank88
38. fibonacci011235
39. Grammr
40. sw0rdz
41. helgapataki
42. snapekilleddumbledore
43. jpcrocker
44. PerfectImage
45. Desley
46. tachat
47. jucanya
48. deojime
49. LeafByNiggle
50. PennyLane91
51. TimeIsMoney
52. rudresha
53. JMTyler
54. commanderblingbling
55. path
56. Bizzle104
57. shants
58. skmenon
59. maeh
60. justwantanaccount
61. ofnep
62. Voido
63. ZZ9PluralZAlphaTowels
64. N0tAUsername
65. ragingFlapjacks
66. greenguy1090
67. captainj321
68. eadlam
69. Oriumpor
70. frenchie
71. TunnyTuna
72. JDragon
73. Hbou
74. 29th
75. longringfinger
76. devils_advocaat
77. Ollie64
78. GodsOfWarMayCry
79. maxcondensed
80. TheMagicPancake
81. jfoo
82. jetblackswan
83. mikeraglass
84. melborp11
85. workismybane
86. kovani
87. acidrayne
88. poopsmooch
89. xmlsi
90. jwall
91. rosieposieosie
92. chaparyan
93. arktemplar
94. probablytom
95. bob
96. arethnaar
97. qu3ry
98. pg1770
99. baloghr
100. elberethf
101. dsimon
102. djm
103. vvviiisss
104. AtlasAnimated
105. Indigo
106. retric
107. .2b.
108. earth584
109. singdawg
110. Knior
111. BornInTheCCCP
112. maverickrhetoric
113. quinn_winters
114. nirajanrk
115. CRichelieu
116. profryan
117. strngr11
118. jamjam
119. EdwardForHire
120. WiseLioness13
121. OctoDawkins
122. AlbinoNeutrino
123. TheVoluntarist
124. m1218
125. Aldem
126. donniemarjer
127. kchar
128. 55five55
129. psYberspRe4Dd
130. pvejunky12
131. S-Skyler
132. jdonald32
133. IonGyth
134. Mystique
135. Janus
136. xerxexrex
137. lewd_librarian
138. jmpx
139. danait
140. clembo99
141. iwanttolearnmaths
142. theblueprint
143. wandabee
144. soldierno77
145. ladydoesbad
146. rozzer
147. nirav
148. mikeypuff
149. inertia
150. EvilKettle
151. Tenku
152. sumguysr
153. mrelitekrown
154. Nischal
155. liutanyu
156. ejk314
157. TheRuler123
158. Malpaso
159. lemonbrains
160. rovar
161. glitchmeister
162. Ophashias
163. tribbettz
164. mrtwiddletoes
165. phro
166. Hotkeys
167. fattybake
168. FerrousMan
169. dstilwell
170. mike7006
171. allxk
172. Flame_Alchemist
173. wasif_hyder
174. hermioneweasley
175. ikeamoah
176. proteanbeing
177. rosatryne
178. steeve149
179. Zoccihedron
180. LightBringer777
181. kalareth
182. Speaknoevil2
183. kevstew
184. lookingforsome
185. theschwaa
186. sellas
187. tlilz
188. cpryby
189. theansweris7
190. hambonebrown
191. spencerutt
192. Sblood
193. Okidoki
194. jmilesporter
195. Maromi
196. J00nes
197. qwertykris
198. AmundsenJunior
199. jomriet
200. shutup
201. sheevyR
202. galka12345
203. zacharymax
204. praneeth
205. Trkrtrk
206. Somatostatin
207. qzpmwxin
208. Swani
209. chinsi
210. snth
211. saputello
212. TMalthus
213. haisuli
214. Santabot
215. swapex
216. Alexander10110
217. Songerie
218. senusert
219. Shalemanse
220. zentropia
221. josemariaruiz
222. shalombi
223. Islambekm
224. educ210student
225. addemf
226. _rhythmx
227. linkizcool
228. Holy_Shit_Stains
229. Nightriser
230. thederpytrombonist
231. jajajaman
232. Blokely
233. jongathan
234. learnmeup
235. cfarlin83
236. paulpc32
237. xyendor
238. widdershins
239. greenhairedfae
240. lambdaofgod
241. parker.jones
242. pequod
243. DeNE
244. diamondium
245. pandaman2123
246. freiheitkampfer
247. gouthamkgh
248. vfxGer
249. richsin
250. vanda
251. netmax2k
252. coolgle
253. hslw
254. blis
255. fer_puricelli
256. genericzombie
257. ncms1990
258. Seven
259. Supergirljulz
260. Solvoid
261. lostandround
262. hjmb
263. Strudel
264. azzaleib
265. mikhail70lock
266. RAMprogrammer
267. wavesofnoise
268. Clemenreau
269. sherlockian_holmes
270. petebikes
271. besz
272. dluekant
273. wongse
274. TreeMuncher
275. iazid
276. Dansauce
277. shadow
278. Nicole.k.d
279. Hamza20697
280. zalezale
281. doctor_cool_phd
282. zakiaziz
283. simonr93
284. noopps
285. skm964
286. ArsonistNightfire
287. buzzeru
288. spunkygermanicus
289. jgoot
290. jjshinobi
291. tilfes
292. aboudib
293. smooochy
294. neevor
295. r1pp3rj4ck
296. LisaMCooper
297. ChesterHiggenbothum
298. rexpan
299. uberakash
300. jamesorice
301. rinkajgoyal
302. liebstraum
303. jcurol4
304. underacrimsonsky
305. goldayce
306. Pinchi
307. imconfus
308. rinkaj
309. mirorakonto
310. doctorflash
311. nakkefame
312. FlyingSheeps
313. Joshuac
314. rruncie
315. caracotsios
316. yoniYalovitsky
317. RATwashingM
318. rededward
319. Batchmuffin
320. grumbleperson
321. ajmori2
322. aamirazeem
323. WeaponsMaster9
324. falling_like_flying
325. hobn
326. LulzyKitten
327. donramses
328. raptorshoelace
329. raptorshoelace
330. raptorshoelace
331. raptorshoelace
332. raptorshoelace
333. imhyperdearie
334. Mrmer
335. DasButt
336. drnewman
337. Halvarian
338. brb_hunting_aliens
339. therob
340. xanbo
341. emichang
342. nushublushu
343. pvtfawkes
344. en27
345. flyingraccoon
346. packersfan25
347. rockstardavid
348. dimosbattu
349. useeeeee
350. Mortengu
351. Rdslnc
352. cloris97
353. ryustreetfighter
354. viper1092
355. johnbak
356. isaaclee96
357. Lezarkween
358. MoistlyNeutral
359. sin4life
360. RosyPancakes
361. osculator
362. Lydraneha
363. soaker
364. LQTMS
365. mralbu
366. lemannequin
367. that70sred
368. pyroholic
369. razbperry11
370. zeronone
371. shord143
372. alexandergunnarson
373. Gatanka
374. vkc
375. Tigburr
376. atakan
377. sfawkes
378. HaroldWales
379. Rupen144
380. uritz
381. fkgtz013
382. bringingsphexyback
383. erobhag
384. tteske
385. reddishlynx
386. bixiedust102
387. SMETA
388. mobyxe
389. Colacanth
390. webdril
391. Mastermind
392. gregorytj
393. hjalmars
394. gaurav1729
395. bigbenvj
396. karasutengu
397. georgeman007
398. youarefree
399. 00alexx
400. r3os
401. mixedrice
402. hokiebeer
403. jgould
404. JacktheFlying
405. abhi111
406. aam
407. PartitaNo2
408. josiki
409. quantumite
410. cynicalceleste
411. TechnicRogue
412. Bimbishkin
413. lx003n
414. bemusedfuse
415. tself918
416. ma6ic
417. admiralgeneral
418. tekno
419. Chipsam
420. olds0ul
421. ilr1
422. charity.bitcoin
423. LordDaedalus
424. Julian
425. Synapse
426. Alex78
427. timrabb211
428. blackcats31
429. freedumb123
430. ficar
431. Dragonduck
432. east89west
433. myreprise
434. awordonducks
435. tillyt
436. eponymic23
437. hazel_fae
438. bpalkmim
439. jaredvv86
440. ValiantEntity
441. davemartin
442. rs332602
443. midnyght219
444. BuryMeInSmoke
445. i_am_squish
446. Grizzly
447. leonbasin
448. tah0ma
449. aaidan
450. IdleCuriosity
451. LakatosI
452. ifr33m4n
453. humblehands
454. jwhitlark
455. NeeBo
456. brentshermana
457. kelly6ridge
458. aevrah
459. oaktownbaby
460. tpkalman
461. terrenon
462. Cattercrush
463. beegee123
464. soulofwren
465. needlearn
466. L2BSmart
467. foo
468. jeremiah
469. teh_tetra
470. Shadeslayr
471. nunofilipemargarido
472. Bennymoonbase
473. crepeknight
474. phiferm
475. somethiax
476. justanother_rocket
477. jsmarquez
478. the_morbid_reality
479. fr0zen
480. conspiracyofqueens
481. Richo1337
482. ljghome
483. and7y
484. wwalid2050
485. furyon
486. turtle_king
487. arka9luv
488. bbmacarthur
489. crichm03
490. shamwow19
491. RicoSpartan
492. pirehappy
493. buguoruci
494. dschwartz266
495. mpmpie
496. Fuckmind
497. jcog69
498. kaneda
499. benshats
500. martyg
501. gerardlouw
502. DowningK19
503. aakast
504. zainussami
505. coffeeblack198
506. relevant_thing
507. TheGreenBastard
508. shitzfez
509. kingosraigi
510. S7u15h
511. Theguybehindthescreen
512. haraf_ijhal
513. cms
514. Hugh472
515. PanKarol
516. lazypakman
517. fauxhemian5
518. WarGy_Luremus
519. namesare4tombstones
520. vincentmakreel
521. jimmyslim22
522. kkmcg21
523. Yaqzan
524. Usagi
525. horses-n-stuff
526. NapoleonBonerpartee
527. Jayhanrygatsby
528. Ajnanin
529. asingh21
530. bob786bob786
531. theguywithacomputer
532. Vapid
533. Rapturehawk
534. ItsQuiteCool
535. CatalinWeb
536. kdlynch12
537. fezspinkguitar
538. EntropicalForest
539. dreamfeastr
540. Higs
541. 20sat92
542. kbanks4130
543. tom_sorrow
544. hooray4alex
545. hderms
546. bendaizer
547. sunkinship
548. afiaust
549. verumnemo
550. SSVanDine
551. Tlequiyahuitl
552. UMurf
553. petemonkeyguts
554. Cody72
555. csraymer
556. cmoney927
557. mrVaNasty
558. silentnuke
559. Alexdabest17
560. Nanodive
561. lella
562. juggler0
563. rajeshsrk
564. bruno30
565. msoup
566. princesspoohs
567. Joecorgi
568. Mystery
569. rajrahul
570. anya5
571. theshruj
572. Martialarts93
573. burubaxair
574. sebadima
575. TheCoinFerret
576. DeanTM
577. jordangold123
578. solrik
579. azharakku97
580. seanknight
581. pmcgee
582. giftgirl2305
583. sarah-ziad
584. Mastermind_Simpleton
585. vinarosta
586. pickup10
587. evdoyle
588. frontraiderz
589. __hsams__
590. gortloveslinux
591. adventure_adventure
592. avi6687
593. grimoireeeeee
594. lokesh_ureddit
595. atikna6
596. ohgoditsdoddy
597. passthegouda
598. joshshefner
599. zimplziman
600. hardy1234
601. dhirenshah3
602. DuesExMachina96
603. soueuls
604. messi
605. vinicius97
606. tais9
607. sevenstarsofstef
608. VonFoerster
609. averei
610. Massdebaters
611. bwstu
612. tzerwic
613. dpdocs21
614. ProteusBound
615. Calcu.Lem.Us
616. acrodemo
617. blakjak02
618. remembrall
619. DedeKey
620. HaroldJIncandenza
621. sarah_ren
622. theEMPTYlife
623. willtoshio
624. AnaMaalisha
625. nodari
626. Halkilt
627. taartun
628. amannedelk
629. madlax
630. astrarum
631. sookoor
632. nitsud
633. Alicia
634. najamkhn
635. tropical_sunlight
636. notmyusername
637. harsh2803
638. tha.jokr
639. ikhsan
640. sasuke1992
641. ismailkite
642. powndy24
643. somethinpoetic21
644. Gundas3073
645. greenredidunno
646. Alythe
647. NewGeek
648. zryang1993
649. jediejr
650. budsofmay
651. marcusv1
652. gavenxl
653. nukeduke
654. shingaling__
655. janart
656. Esrenko
657. RK9fury
658. nebace
659. Cjmclean17
660. bsisman
661. vlaggimus
662. Haymaker33
663. Chokolope
664. adalmia01
665. jhanak
666. sshen
667. a2kram
668. JonascF
669. theflyingbrant
670. hatani
671. Worthy1
672. hegelianlunch
673. CautiousNarwhal
674. daloc22
675. wewillsolvethesky
676. vru11ra
677. RazVayne
678. temet_hates_slippers
679. neoezekiel
680. okyan0
681. hierophantos
682. mirrorman867
683. zephyrean
684. s0fist
685. nredondo82
686. Ggaines
687. mvresh
688. tekalon
689. p3t3r.tnie
690. hydrogendos
691. algibsonsullys
692. vallver
693. Emmaclerk
694. Athar
695. Apeiron91
696. mangeshjoshi819
697. ajwayne
698. sp_solis
699. jessyjinja
700. meechdeemyuke
701. vijaypradhan
702. asilentsound
703. kmmadan7
704. HeeyBob
705. WhiteSpider
706. paydatolltroll
707. ceater259
708. ksimp126
709. neostache
710. 0x00000000
711. DasNasty
712. maftoun95
713. epiquack
714. ongspxm
715. _RaZeR_
716. wutabum17
717. bhagone
718. kodumuru_niranjan
719. angelbar
720. prakharboy
721. spookyfoster
722. blackiszero
723. shilezi
724. SKaori10
725. yudag1
726. Jempress01
727. Jessamysara
728. newb
729. hsams
730. TBLIXXXY