-1+1740 
Journey into Information Theory: The Language of Coins

This epic journey will take us from smoke signals to internet compression and the modern day search for extraterrestrial intelligence. posted on Khan Academy

Lectures
  1. What is Information Theory

    Introduction to the course

  2. Origin of Alphabet

    Explore this origin of pictographic and ideographic writing (proto-writing)

  3. History of the Alphabet

    History of the Alphabet. This video introduces the Hieroglyphic, Cuneiform, Hieratic, Demotic, Phonetician writing systems. It presents information as a series of selections from a finite collection of symbols..

  4. Introduction to Coding Theory

    Introduction to source encoding!

  5. History of Visual Telegraphs

    From signal fires to semaphore lines

  6. Electrostatic Telegraphs

    Explore early telegraph technology using electrostatics

  7. The Battery & Electromagnetism

    The key technology in our story

  8. Morse Code & The Information Age

    Morse Code & The Information Age

  9. Channel Capacity & Baud

    Introduction to Symbols, Signals & Noise

  10. Measuring Information

    Hartley and Nyquist's first attempt to quantify information

  11. Markov Chains

    The origin of Markov Chains

  12. Mathematical Theory of Communication

    Shannon's application of Markov Chains

  13. Entropy

    Introduction to information entropy

  14. Compression Codes

    Huffman coding

Prerequisites

None! Curiosity only...and patience (videos will come out every 2-3 weeks)

Syllabus

Tentative (currently writing this journey)

  • Linguistics (origin of language)
  • History of Alphabet (written language)
  • Media (clay, stone, papyrus, electricity)
  • Origin of Electricity & Magnetism
  • History of Communication (telegraphs)
  • Markov Models
  • Conditional Probability
  • Information Theory (Shannon)
  • Compression
  • Coding
  • Search for Extra Terrestrial Intelligence (information filters)
Additional information

Course begins September 2012 and will run until Summer 2013. Best way to keep up with new stuff is to subscribe here

Teacher qualifications

Studied Information Theory, Mathematics & Computer Science. Faculty member at Khan Academy.

Latest Update
Source Coding (2012-12-06 02:25:16)

"new video up on source coding!"

Roster
1. rogerwilco
2. RaishenC7
3. HiddenFlagon
4. Crimius
5. bamaphdee
6. hotlikearobot
7. zaq12343
8. takamori
9. swoodilypooper
10. Driver1676
11. xaustinx
12. franklintuts
13. Shlldn
14. kyzic
15. sriracha5
16. thaliaschild
17. freewisdom
18. elaufis
19. wuncidunci
20. chngr
21. mooglefrooglian
22. Toepuka
23. zerubroberts
24. eronre12
25. ang
26. Nella
27. PhotonPhighter
28. SoItAlwaysGoes
29. acemonkey18
30. Chanthien
31. bluepickles
32. rdm5181
33. Shadowchai
34. adamimos
35. syzo
36. PalmPaperCut
37. jmank88
38. fibonacci011235
39. Grammr
40. sw0rdz
41. helgapataki
42. snapekilleddumbledore
43. jpcrocker
44. PerfectImage
45. Desley
46. tachat
47. jucanya
48. deojime
49. LeafByNiggle
50. PennyLane91
51. TimeIsMoney
52. rudresha
53. JMTyler
54. commanderblingbling
55. path
56. Bizzle104
57. shants
58. skmenon
59. maeh
60. justwantanaccount
61. ofnep
62. Voido
63. ZZ9PluralZAlphaTowels
64. N0tAUsername
65. ragingFlapjacks
66. greenguy1090
67. captainj321
68. eadlam
69. Oriumpor
70. frenchie
71. TunnyTuna
72. JDragon
73. Hbou
74. 29th
75. longringfinger
76. devils_advocaat
77. Ollie64
78. GodsOfWarMayCry
79. maxcondensed
80. jfoo
81. jetblackswan
82. mikeraglass
83. melborp11
84. workismybane
85. kovani
86. acidrayne
87. poopsmooch
88. xmlsi
89. jwall
90. rosieposieosie
91. chaparyan
92. arktemplar
93. probablytom
94. bob
95. arethnaar
96. qu3ry
97. pg1770
98. baloghr
99. elberethf
100. dsimon
101. djm
102. vvviiisss
103. AtlasAnimated
104. Indigo
105. retric
106. .2b.
107. earth584
108. singdawg
109. Knior
110. BornInTheCCCP
111. maverickrhetoric
112. quinn_winters
113. nirajanrk
114. CRichelieu
115. profryan
116. strngr11
117. jamjam
118. EdwardForHire
119. WiseLioness13
120. OctoDawkins
121. AlbinoNeutrino
122. TheVoluntarist
123. m1218
124. Aldem
125. donniemarjer
126. kchar
127. 55five55
128. psYberspRe4Dd
129. pvejunky12
130. S-Skyler
131. jdonald32
132. IonGyth
133. Mystique
134. Janus
135. xerxexrex
136. lewd_librarian
137. jmpx
138. danait
139. clembo99
140. iwanttolearnmaths
141. theblueprint
142. wandabee
143. soldierno77
144. ladydoesbad
145. rozzer
146. nirav
147. mikeypuff
148. inertia
149. EvilKettle
150. Tenku
151. sumguysr
152. mrelitekrown
153. Nischal
154. liutanyu
155. ejk314
156. TheRuler123
157. Malpaso
158. lemonbrains
159. rovar
160. glitchmeister
161. Ophashias
162. tribbettz
163. mrtwiddletoes
164. phro
165. Hotkeys
166. fattybake
167. FerrousMan
168. dstilwell
169. mike7006
170. allxk
171. Flame_Alchemist
172. wasif_hyder
173. hermioneweasley
174. ikeamoah
175. proteanbeing
176. rosatryne
177. steeve149
178. Zoccihedron
179. LightBringer777
180. kalareth
181. Speaknoevil2
182. kevstew
183. lookingforsome
184. theschwaa
185. sellas
186. tlilz
187. cpryby
188. theansweris7
189. hambonebrown
190. spencerutt
191. Sblood
192. Okidoki
193. jmilesporter
194. Maromi
195. J00nes
196. qwertykris
197. AmundsenJunior
198. jomriet
199. shutup
200. sheevyR
201. galka12345
202. zacharymax
203. praneeth
204. Trkrtrk
205. Somatostatin
206. qzpmwxin
207. Swani
208. chinsi
209. snth
210. saputello
211. TMalthus
212. haisuli
213. Santabot
214. swapex
215. Alexander10110
216. Songerie
217. senusert
218. Shalemanse
219. zentropia
220. josemariaruiz
221. shalombi
222. Islambekm
223. educ210student
224. _rhythmx
225. linkizcool
226. Holy_Shit_Stains
227. Nightriser
228. thederpytrombonist
229. jajajaman
230. Blokely
231. jongathan
232. learnmeup
233. cfarlin83
234. paulpc32
235. xyendor
236. widdershins
237. greenhairedfae
238. lambdaofgod
239. parker.jones
240. pequod
241. DeNE
242. diamondium
243. pandaman2123
244. freiheitkampfer
245. gouthamkgh
246. vfxGer
247. richsin
248. vanda
249. netmax2k
250. coolgle
251. hslw
252. blis
253. fer_puricelli
254. genericzombie
255. ncms1990
256. Seven
257. Supergirljulz
258. Solvoid
259. lostandround
260. hjmb
261. Strudel
262. azzaleib
263. mikhail70lock
264. RAMprogrammer
265. wavesofnoise
266. Clemenreau
267. sherlockian_holmes
268. petebikes
269. besz
270. dluekant
271. wongse
272. TreeMuncher
273. iazid
274. Dansauce
275. shadow
276. Nicole.k.d
277. Hamza20697
278. zalezale
279. doctor_cool_phd
280. zakiaziz
281. simonr93
282. noopps
283. skm964
284. ArsonistNightfire
285. buzzeru
286. spunkygermanicus
287. jgoot
288. jjshinobi
289. tilfes
290. aboudib
291. smooochy
292. neevor
293. r1pp3rj4ck
294. LisaMCooper
295. ChesterHiggenbothum
296. rexpan
297. uberakash
298. jamesorice
299. rinkajgoyal
300. liebstraum
301. jcurol4
302. underacrimsonsky
303. goldayce
304. Pinchi
305. imconfus
306. rinkaj
307. mirorakonto
308. doctorflash
309. nakkefame
310. FlyingSheeps
311. Joshuac
312. rruncie
313. caracotsios
314. yoniYalovitsky
315. RATwashingM
316. rededward
317. Batchmuffin
318. grumbleperson
319. ajmori2
320. aamirazeem
321. WeaponsMaster9
322. falling_like_flying
323. hobn
324. LulzyKitten
325. donramses
326. raptorshoelace
327. raptorshoelace
328. raptorshoelace
329. raptorshoelace
330. raptorshoelace
331. imhyperdearie
332. Mrmer
333. DasButt
334. drnewman
335. Halvarian
336. brb_hunting_aliens
337. therob
338. xanbo
339. emichang
340. nushublushu
341. pvtfawkes
342. en27
343. flyingraccoon
344. packersfan25
345. rockstardavid
346. dimosbattu
347. useeeeee
348. Mortengu
349. Rdslnc
350. cloris97
351. ryustreetfighter
352. viper1092
353. johnbak
354. isaaclee96
355. Lezarkween
356. MoistlyNeutral
357. sin4life
358. RosyPancakes
359. osculator
360. Lydraneha
361. soaker
362. LQTMS
363. mralbu
364. lemannequin
365. that70sred
366. pyroholic
367. razbperry11
368. zeronone
369. shord143
370. alexandergunnarson
371. Gatanka
372. vkc
373. Tigburr
374. atakan
375. sfawkes
376. HaroldWales
377. Rupen144
378. uritz
379. fkgtz013
380. bringingsphexyback
381. erobhag
382. tteske
383. reddishlynx
384. bixiedust102
385. SMETA
386. mobyxe
387. Colacanth
388. webdril
389. Mastermind
390. gregorytj
391. hjalmars
392. gaurav1729
393. bigbenvj
394. karasutengu
395. georgeman007
396. youarefree
397. 00alexx
398. r3os
399. mixedrice
400. hokiebeer
401. jgould
402. JacktheFlying
403. abhi111
404. aam
405. PartitaNo2
406. josiki
407. quantumite
408. cynicalceleste
409. TechnicRogue
410. Bimbishkin
411. lx003n
412. bemusedfuse
413. tself918
414. ma6ic
415. admiralgeneral
416. tekno
417. Chipsam
418. olds0ul
419. ilr1
420. charity.bitcoin
421. LordDaedalus
422. Julian
423. Synapse
424. Alex78
425. timrabb211
426. blackcats31
427. freedumb123
428. ficar
429. Dragonduck
430. east89west
431. myreprise
432. awordonducks
433. tillyt
434. eponymic23
435. hazel_fae
436. bpalkmim
437. jaredvv86
438. ValiantEntity
439. davemartin
440. rs332602
441. midnyght219
442. BuryMeInSmoke
443. i_am_squish
444. Grizzly
445. leonbasin
446. tah0ma
447. aaidan
448. IdleCuriosity
449. LakatosI
450. ifr33m4n
451. humblehands
452. jwhitlark
453. NeeBo
454. brentshermana
455. kelly6ridge
456. aevrah
457. oaktownbaby
458. tpkalman
459. terrenon
460. Cattercrush
461. beegee123
462. soulofwren
463. needlearn
464. L2BSmart
465. foo
466. jeremiah
467. teh_tetra
468. Shadeslayr
469. nunofilipemargarido
470. Bennymoonbase
471. crepeknight
472. phiferm
473. somethiax
474. justanother_rocket
475. jsmarquez
476. the_morbid_reality
477. fr0zen
478. conspiracyofqueens
479. Richo1337
480. ljghome
481. and7y
482. wwalid2050
483. furyon
484. turtle_king
485. arka9luv
486. bbmacarthur
487. crichm03
488. shamwow19
489. RicoSpartan
490. pirehappy
491. buguoruci
492. dschwartz266
493. mpmpie
494. Fuckmind
495. jcog69
496. kaneda
497. benshats
498. martyg
499. gerardlouw
500. DowningK19
501. aakast
502. zainussami
503. coffeeblack198
504. relevant_thing
505. TheGreenBastard
506. shitzfez
507. kingosraigi
508. S7u15h
509. Theguybehindthescreen
510. haraf_ijhal
511. cms
512. Hugh472
513. PanKarol
514. lazypakman
515. fauxhemian5
516. WarGy_Luremus
517. namesare4tombstones
518. vincentmakreel
519. jimmyslim22
520. kkmcg21
521. Yaqzan
522. Usagi
523. horses-n-stuff
524. NapoleonBonerpartee
525. Jayhanrygatsby
526. Ajnanin
527. asingh21
528. bob786bob786
529. theguywithacomputer
530. Vapid
531. Rapturehawk
532. ItsQuiteCool
533. CatalinWeb
534. kdlynch12
535. fezspinkguitar
536. EntropicalForest
537. dreamfeastr
538. Higs
539. 20sat92
540. kbanks4130
541. tom_sorrow
542. hooray4alex
543. hderms
544. bendaizer
545. sunkinship
546. afiaust
547. verumnemo
548. SSVanDine
549. Tlequiyahuitl
550. UMurf
551. petemonkeyguts
552. Cody72
553. csraymer
554. cmoney927
555. mrVaNasty
556. silentnuke
557. Alexdabest17
558. Nanodive
559. lella
560. juggler0
561. rajeshsrk
562. bruno30
563. msoup
564. princesspoohs
565. Joecorgi
566. Mystery
567. rajrahul
568. anya5
569. theshruj
570. Martialarts93
571. burubaxair
572. sebadima
573. TheCoinFerret
574. DeanTM
575. jordangold123
576. solrik
577. azharakku97
578. seanknight
579. pmcgee
580. giftgirl2305
581. sarah-ziad
582. Mastermind_Simpleton
583. vinarosta
584. pickup10
585. evdoyle
586. frontraiderz
587. __hsams__
588. gortloveslinux
589. adventure_adventure
590. avi6687
591. grimoireeeeee
592. lokesh_ureddit
593. atikna6
594. ohgoditsdoddy
595. passthegouda
596. joshshefner
597. zimplziman
598. hardy1234
599. dhirenshah3
600. DuesExMachina96
601. soueuls
602. messi
603. vinicius97
604. tais9
605. sevenstarsofstef
606. VonFoerster
607. averei
608. Massdebaters
609. bwstu
610. tzerwic
611. dpdocs21
612. ProteusBound
613. Calcu.Lem.Us
614. acrodemo
615. blakjak02
616. remembrall
617. DedeKey
618. HaroldJIncandenza
619. sarah_ren
620. theEMPTYlife
621. willtoshio
622. AnaMaalisha
623. nodari
624. Halkilt
625. taartun
626. amannedelk
627. madlax
628. astrarum
629. sookoor
630. nitsud
631. Alicia
632. najamkhn
633. tropical_sunlight
634. notmyusername
635. harsh2803
636. tha.jokr
637. ikhsan
638. sasuke1992
639. ismailkite
640. powndy24
641. somethinpoetic21
642. Gundas3073
643. greenredidunno
644. Alythe
645. NewGeek
646. zryang1993
647. jediejr
648. budsofmay
649. marcusv1
650. gavenxl
651. nukeduke
652. shingaling__
653. janart
654. Esrenko
655. RK9fury
656. nebace
657. Cjmclean17
658. bsisman
659. vlaggimus
660. Haymaker33
661. Chokolope
662. adalmia01
663. jhanak
664. sshen
665. a2kram
666. JonascF
667. theflyingbrant
668. hatani
669. Worthy1
670. hegelianlunch
671. CautiousNarwhal
672. daloc22
673. wewillsolvethesky
674. vru11ra
675. RazVayne
676. temet_hates_slippers
677. neoezekiel
678. okyan0
679. hierophantos
680. mirrorman867
681. zephyrean
682. s0fist
683. nredondo82
684. Ggaines
685. mvresh
686. tekalon
687. p3t3r.tnie
688. hydrogendos
689. algibsonsullys
690. vallver
691. Emmaclerk
692. Athar
693. Apeiron91
694. mangeshjoshi819
695. ajwayne
696. sp_solis
697. jessyjinja
698. meechdeemyuke
699. vijaypradhan
700. asilentsound
701. kmmadan7
702. HeeyBob
703. WhiteSpider
704. paydatolltroll
705. ceater259
706. ksimp126
707. neostache
708. 0x00000000
709. DasNasty
710. maftoun95
711. epiquack
712. ongspxm
713. _RaZeR_
714. wutabum17
715. bhagone
716. kodumuru_niranjan
717. angelbar
718. prakharboy
719. spookyfoster
720. blackiszero
721. shilezi
722. SKaori10
723. yudag1
724. Jempress01
725. Jessamysara
726. newb
727. hsams
728. TBLIXXXY
729. Solicited_Advice_Plz
730. skframe
731. Mkeita23
732. khier
733. pnkarthik1992
734. orangetomato
735. Keiryn
736. TK192
737. jaidgossamer
738. lydwak
739. Dve
740. zcrltt
741. piroucroix
742. Girish123
743. TibbyKay
744. Anj2017
745. sharmav996
746. tillytilda
747. solidstill
748. Yanna210
749. k0rt3z
750. Monte_Cristo
751. coughsyrupahoy
752. lance_hall
753. washychainz
754. ahmed5_27
755. dhirubhai
756. issa26
757. Ganesh5948
758. MAHIPAL_KULADIYA
759. darkarchang3l
760. JediMasterSaulAdama
761. NickoleA
762. v1n337
763. alekcrane
764. Vincenttaylor99k
765. buttscratcher3000
766. surajKrish211
767. PurpleSamosa
768. ssamuelson1906
769. mohamed007
770. Alveolatic
771. Visar
772. YanFengLin
773. blockcitylabs
774. gummadhav
775. bacchtrack
776. txredking90
777. Vishal3011
778. EMBaker0427
779. GunsoSniper
780. kunaljain86
781. Tetiana_Lytvyniuk
782. munkbatodbayar
783. johnwynor
784. arushs
785. vpraveenindia