-1+1695 
Journey into Information Theory: The Language of Coins

This epic journey will take us from smoke signals to internet compression and the modern day search for extraterrestrial intelligence. posted on Khan Academy

Lectures
  1. What is Information Theory

    Introduction to the course

  2. Origin of Alphabet

    Explore this origin of pictographic and ideographic writing (proto-writing)

  3. History of the Alphabet

    History of the Alphabet. This video introduces the Hieroglyphic, Cuneiform, Hieratic, Demotic, Phonetician writing systems. It presents information as a series of selections from a finite collection of symbols..

  4. Introduction to Coding Theory

    Introduction to source encoding!

  5. History of Visual Telegraphs

    From signal fires to semaphore lines

  6. Electrostatic Telegraphs

    Explore early telegraph technology using electrostatics

  7. The Battery & Electromagnetism

    The key technology in our story

  8. Morse Code & The Information Age

    Morse Code & The Information Age

  9. Channel Capacity & Baud

    Introduction to Symbols, Signals & Noise

  10. Measuring Information

    Hartley and Nyquist's first attempt to quantify information

  11. Markov Chains

    The origin of Markov Chains

  12. Mathematical Theory of Communication

    Shannon's application of Markov Chains

  13. Entropy

    Introduction to information entropy

  14. Compression Codes

    Huffman coding

Prerequisites

None! Curiosity only...and patience (videos will come out every 2-3 weeks)

Syllabus

Tentative (currently writing this journey)

  • Linguistics (origin of language)
  • History of Alphabet (written language)
  • Media (clay, stone, papyrus, electricity)
  • Origin of Electricity & Magnetism
  • History of Communication (telegraphs)
  • Markov Models
  • Conditional Probability
  • Information Theory (Shannon)
  • Compression
  • Coding
  • Search for Extra Terrestrial Intelligence (information filters)
Additional information

Course begins September 2012 and will run until Summer 2013. Best way to keep up with new stuff is to subscribe here

Teacher qualifications

Studied Information Theory, Mathematics & Computer Science. Faculty member at Khan Academy.

Latest Update
Source Coding (2012-12-06 02:25:16)

"new video up on source coding!"

Roster
1. rogerwilco
2. RaishenC7
3. HiddenFlagon
4. Crimius
5. bamaphdee
6. hotlikearobot
7. zaq12343
8. takamori
9. swoodilypooper
10. Driver1676
11. xaustinx
12. franklintuts
13. Shlldn
14. kyzic
15. sriracha5
16. thaliaschild
17. freewisdom
18. elaufis
19. wuncidunci
20. chngr
21. mooglefrooglian
22. Toepuka
23. zerubroberts
24. eronre12
25. ang
26. Nella
27. PhotonPhighter
28. SoItAlwaysGoes
29. acemonkey18
30. Chanthien
31. bluepickles
32. rdm5181
33. Shadowchai
34. adamimos
35. syzo
36. PalmPaperCut
37. jmank88
38. fibonacci011235
39. Grammr
40. sw0rdz
41. helgapataki
42. snapekilleddumbledore
43. jpcrocker
44. PerfectImage
45. Desley
46. tachat
47. jucanya
48. deojime
49. LeafByNiggle
50. PennyLane91
51. TimeIsMoney
52. rudresha
53. JMTyler
54. commanderblingbling
55. path
56. Bizzle104
57. shants
58. skmenon
59. maeh
60. justwantanaccount
61. ofnep
62. Voido
63. ZZ9PluralZAlphaTowels
64. N0tAUsername
65. ragingFlapjacks
66. greenguy1090
67. captainj321
68. eadlam
69. Oriumpor
70. frenchie
71. TunnyTuna
72. JDragon
73. Hbou
74. 29th
75. longringfinger
76. devils_advocaat
77. Ollie64
78. GodsOfWarMayCry
79. maxcondensed
80. TheMagicPancake
81. jfoo
82. jetblackswan
83. mikeraglass
84. melborp11
85. workismybane
86. kovani
87. acidrayne
88. poopsmooch
89. xmlsi
90. jwall
91. rosieposieosie
92. chaparyan
93. arktemplar
94. probablytom
95. bob
96. arethnaar
97. qu3ry
98. pg1770
99. baloghr
100. elberethf
101. dsimon
102. djm
103. vvviiisss
104. AtlasAnimated
105. Indigo
106. retric
107. .2b.
108. earth584
109. singdawg
110. Knior
111. BornInTheCCCP
112. maverickrhetoric
113. quinn_winters
114. nirajanrk
115. CRichelieu
116. profryan
117. strngr11
118. jamjam
119. EdwardForHire
120. WiseLioness13
121. OctoDawkins
122. AlbinoNeutrino
123. TheVoluntarist
124. m1218
125. Aldem
126. donniemarjer
127. kchar
128. 55five55
129. psYberspRe4Dd
130. pvejunky12
131. S-Skyler
132. jdonald32
133. IonGyth
134. Mystique
135. Janus
136. xerxexrex
137. lewd_librarian
138. jmpx
139. danait
140. clembo99
141. iwanttolearnmaths
142. theblueprint
143. wandabee
144. soldierno77
145. ladydoesbad
146. rozzer
147. nirav
148. mikeypuff
149. inertia
150. EvilKettle
151. Tenku
152. sumguysr
153. mrelitekrown
154. Nischal
155. liutanyu
156. ejk314
157. TheRuler123
158. Malpaso
159. lemonbrains
160. rovar
161. glitchmeister
162. Ophashias
163. tribbettz
164. mrtwiddletoes
165. phro
166. Hotkeys
167. fattybake
168. FerrousMan
169. dstilwell
170. mike7006
171. allxk
172. Flame_Alchemist
173. wasif_hyder
174. hermioneweasley
175. ikeamoah
176. proteanbeing
177. rosatryne
178. steeve149
179. Zoccihedron
180. LightBringer777
181. kalareth
182. Speaknoevil2
183. kevstew
184. lookingforsome
185. theschwaa
186. sellas
187. tlilz
188. cpryby
189. theansweris7
190. hambonebrown
191. spencerutt
192. Sblood
193. Okidoki
194. jmilesporter
195. Maromi
196. J00nes
197. qwertykris
198. AmundsenJunior
199. jomriet
200. shutup
201. sheevyR
202. galka12345
203. zacharymax
204. praneeth
205. Trkrtrk
206. Somatostatin
207. qzpmwxin
208. Swani
209. chinsi
210. snth
211. saputello
212. TMalthus
213. haisuli
214. Santabot
215. swapex
216. Alexander10110
217. Songerie
218. senusert
219. Shalemanse
220. zentropia
221. josemariaruiz
222. shalombi
223. Islambekm
224. educ210student
225. _rhythmx
226. linkizcool
227. Holy_Shit_Stains
228. Nightriser
229. thederpytrombonist
230. jajajaman
231. Blokely
232. jongathan
233. learnmeup
234. cfarlin83
235. paulpc32
236. xyendor
237. widdershins
238. greenhairedfae
239. lambdaofgod
240. parker.jones
241. pequod
242. DeNE
243. diamondium
244. pandaman2123
245. freiheitkampfer
246. gouthamkgh
247. vfxGer
248. richsin
249. vanda
250. netmax2k
251. coolgle
252. hslw
253. blis
254. fer_puricelli
255. genericzombie
256. ncms1990
257. Seven
258. Supergirljulz
259. Solvoid
260. lostandround
261. hjmb
262. Strudel
263. azzaleib
264. mikhail70lock
265. RAMprogrammer
266. wavesofnoise
267. Clemenreau
268. sherlockian_holmes
269. petebikes
270. besz
271. dluekant
272. wongse
273. TreeMuncher
274. iazid
275. Dansauce
276. shadow
277. Nicole.k.d
278. Hamza20697
279. zalezale
280. doctor_cool_phd
281. zakiaziz
282. simonr93
283. noopps
284. skm964
285. ArsonistNightfire
286. buzzeru
287. spunkygermanicus
288. jgoot
289. jjshinobi
290. tilfes
291. aboudib
292. smooochy
293. neevor
294. r1pp3rj4ck
295. LisaMCooper
296. ChesterHiggenbothum
297. rexpan
298. uberakash
299. jamesorice
300. rinkajgoyal
301. liebstraum
302. jcurol4
303. underacrimsonsky
304. goldayce
305. Pinchi
306. imconfus
307. rinkaj
308. mirorakonto
309. doctorflash
310. nakkefame
311. FlyingSheeps
312. Joshuac
313. rruncie
314. caracotsios
315. yoniYalovitsky
316. RATwashingM
317. rededward
318. Batchmuffin
319. grumbleperson
320. ajmori2
321. aamirazeem
322. WeaponsMaster9
323. falling_like_flying
324. hobn
325. LulzyKitten
326. donramses
327. raptorshoelace
328. raptorshoelace
329. raptorshoelace
330. raptorshoelace
331. raptorshoelace
332. imhyperdearie
333. Mrmer
334. DasButt
335. drnewman
336. Halvarian
337. brb_hunting_aliens
338. therob
339. xanbo
340. emichang
341. nushublushu
342. pvtfawkes
343. en27
344. flyingraccoon
345. packersfan25
346. rockstardavid
347. dimosbattu
348. useeeeee
349. Mortengu
350. Rdslnc
351. cloris97
352. ryustreetfighter
353. viper1092
354. johnbak
355. isaaclee96
356. Lezarkween
357. MoistlyNeutral
358. sin4life
359. RosyPancakes
360. osculator
361. Lydraneha
362. soaker
363. LQTMS
364. mralbu
365. lemannequin
366. that70sred
367. pyroholic
368. razbperry11
369. zeronone
370. shord143
371. alexandergunnarson
372. Gatanka
373. vkc
374. Tigburr
375. atakan
376. sfawkes
377. HaroldWales
378. Rupen144
379. uritz
380. fkgtz013
381. bringingsphexyback
382. erobhag
383. tteske
384. reddishlynx
385. bixiedust102
386. SMETA
387. mobyxe
388. Colacanth
389. webdril
390. Mastermind
391. gregorytj
392. hjalmars
393. gaurav1729
394. bigbenvj
395. karasutengu
396. georgeman007
397. youarefree
398. 00alexx
399. r3os
400. mixedrice
401. hokiebeer
402. jgould
403. JacktheFlying
404. abhi111
405. aam
406. PartitaNo2
407. josiki
408. quantumite
409. cynicalceleste
410. TechnicRogue
411. Bimbishkin
412. lx003n
413. bemusedfuse
414. tself918
415. ma6ic
416. admiralgeneral
417. tekno
418. Chipsam
419. olds0ul
420. ilr1
421. charity.bitcoin
422. LordDaedalus
423. Julian
424. Synapse
425. Alex78
426. timrabb211
427. blackcats31
428. freedumb123
429. ficar
430. Dragonduck
431. east89west
432. myreprise
433. awordonducks
434. tillyt
435. eponymic23
436. hazel_fae
437. bpalkmim
438. jaredvv86
439. ValiantEntity
440. davemartin
441. rs332602
442. midnyght219
443. BuryMeInSmoke
444. i_am_squish
445. Grizzly
446. leonbasin
447. tah0ma
448. aaidan
449. IdleCuriosity
450. LakatosI
451. ifr33m4n
452. humblehands
453. jwhitlark
454. NeeBo
455. brentshermana
456. kelly6ridge
457. aevrah
458. oaktownbaby
459. tpkalman
460. terrenon
461. Cattercrush
462. beegee123
463. soulofwren
464. needlearn
465. L2BSmart
466. foo
467. jeremiah
468. teh_tetra
469. Shadeslayr
470. nunofilipemargarido
471. Bennymoonbase
472. crepeknight
473. phiferm
474. somethiax
475. justanother_rocket
476. jsmarquez
477. the_morbid_reality
478. fr0zen
479. conspiracyofqueens
480. Richo1337
481. ljghome
482. and7y
483. wwalid2050
484. furyon
485. turtle_king
486. arka9luv
487. bbmacarthur
488. crichm03
489. shamwow19
490. RicoSpartan
491. pirehappy
492. buguoruci
493. dschwartz266
494. mpmpie
495. Fuckmind
496. jcog69
497. kaneda
498. benshats
499. martyg
500. gerardlouw
501. DowningK19
502. aakast
503. zainussami
504. coffeeblack198
505. relevant_thing
506. TheGreenBastard
507. shitzfez
508. kingosraigi
509. S7u15h
510. Theguybehindthescreen
511. haraf_ijhal
512. cms
513. Hugh472
514. PanKarol
515. lazypakman
516. fauxhemian5
517. WarGy_Luremus
518. namesare4tombstones
519. vincentmakreel
520. jimmyslim22
521. kkmcg21
522. Yaqzan
523. Usagi
524. horses-n-stuff
525. NapoleonBonerpartee
526. Jayhanrygatsby
527. Ajnanin
528. asingh21
529. bob786bob786
530. theguywithacomputer
531. Vapid
532. Rapturehawk
533. ItsQuiteCool
534. CatalinWeb
535. kdlynch12
536. fezspinkguitar
537. EntropicalForest
538. dreamfeastr
539. Higs
540. 20sat92
541. kbanks4130
542. tom_sorrow
543. hooray4alex
544. hderms
545. bendaizer
546. sunkinship
547. afiaust
548. verumnemo
549. SSVanDine
550. Tlequiyahuitl
551. UMurf
552. petemonkeyguts
553. Cody72
554. csraymer
555. cmoney927
556. mrVaNasty
557. silentnuke
558. Alexdabest17
559. Nanodive
560. lella
561. juggler0
562. rajeshsrk
563. bruno30
564. msoup
565. princesspoohs
566. Joecorgi
567. Mystery
568. rajrahul
569. anya5
570. theshruj
571. Martialarts93
572. burubaxair
573. sebadima
574. TheCoinFerret
575. DeanTM
576. jordangold123
577. solrik
578. azharakku97
579. seanknight
580. pmcgee
581. giftgirl2305
582. sarah-ziad
583. Mastermind_Simpleton
584. vinarosta
585. pickup10
586. evdoyle
587. frontraiderz
588. __hsams__
589. gortloveslinux
590. adventure_adventure
591. avi6687
592. grimoireeeeee
593. lokesh_ureddit
594. atikna6
595. ohgoditsdoddy
596. passthegouda
597. joshshefner
598. zimplziman
599. hardy1234
600. dhirenshah3
601. DuesExMachina96
602. soueuls
603. messi
604. vinicius97
605. tais9
606. sevenstarsofstef
607. VonFoerster
608. averei
609. Massdebaters
610. bwstu
611. tzerwic
612. dpdocs21
613. ProteusBound
614. Calcu.Lem.Us
615. acrodemo
616. blakjak02
617. remembrall
618. DedeKey
619. HaroldJIncandenza
620. sarah_ren
621. theEMPTYlife
622. willtoshio
623. AnaMaalisha
624. nodari
625. Halkilt
626. taartun
627. amannedelk
628. madlax
629. astrarum
630. sookoor
631. nitsud
632. Alicia
633. najamkhn
634. tropical_sunlight
635. notmyusername
636. harsh2803
637. tha.jokr
638. ikhsan
639. sasuke1992
640. ismailkite
641. powndy24
642. somethinpoetic21
643. Gundas3073
644. greenredidunno
645. Alythe
646. NewGeek
647. zryang1993
648. jediejr
649. budsofmay
650. marcusv1
651. gavenxl
652. nukeduke
653. shingaling__
654. janart
655. Esrenko
656. RK9fury
657. nebace
658. Cjmclean17
659. bsisman
660. vlaggimus
661. Haymaker33
662. Chokolope
663. adalmia01
664. jhanak
665. sshen
666. a2kram
667. JonascF
668. theflyingbrant
669. hatani
670. Worthy1
671. hegelianlunch
672. CautiousNarwhal
673. daloc22
674. wewillsolvethesky
675. vru11ra
676. RazVayne
677. temet_hates_slippers
678. neoezekiel
679. okyan0
680. hierophantos
681. mirrorman867
682. zephyrean
683. s0fist
684. nredondo82
685. Ggaines
686. mvresh
687. tekalon
688. p3t3r.tnie
689. hydrogendos
690. algibsonsullys
691. vallver
692. Emmaclerk
693. Athar
694. Apeiron91
695. mangeshjoshi819
696. ajwayne
697. sp_solis
698. jessyjinja
699. meechdeemyuke
700. vijaypradhan
701. asilentsound
702. kmmadan7
703. HeeyBob
704. WhiteSpider
705. paydatolltroll
706. ceater259
707. ksimp126
708. neostache
709. 0x00000000
710. DasNasty
711. maftoun95
712. epiquack
713. ongspxm
714. _RaZeR_
715. wutabum17
716. bhagone
717. kodumuru_niranjan
718. angelbar
719. prakharboy
720. spookyfoster
721. blackiszero
722. shilezi
723. SKaori10
724. yudag1
725. Jempress01
726. Jessamysara
727. newb
728. hsams
729. TBLIXXXY
730. Solicited_Advice_Plz
731. skframe
732. Mkeita23
733. khier
734. pnkarthik1992
735. orangetomato
736. Keiryn
737. TK192