The Zipf Mystery
21:05
18,896,528
Reddit
The of and to. A in is I. That it, for you, was with on. As have ... but be they.
RELATED LINKS AND SOURCES BELOW!
twitter.com/tweetsauce
instagram.com/electricpants
WordCount.org www.wordcount.org/
How many days have you been alive? www.beatcanvas.com/daysalive.asp
random letter generator: www.dave-reed.com/Nifty/randSeq.html
Dictionary of Obscure Sorrows: rsloft.info
Word frequency resources:
[lemmatized] en.wikipedia.org/wiki/Most_common_words_in_English
www.uow.edu.au/~dlee/corpora.htm
www.wordfrequency.info
www.anc.org/data/anc-second-release/frequency-data/
www.titania.bham.ac.uk/docs/
www.kilgarriff.co.uk/bnc-readme.html#raw
en.wiktionary.org/wiki/Wiktionary:Frequency_lists
ucrel.lancs.ac.uk/bncfreq/
[PDF] www.wordfrequency.info/files/entries.pdf
[combined Wikipedia and Gutenberg] www.monlp.com/2012/04/16/calculating-word-and-n-gram-statistics-from-a-wikipedia-corpora/
corpus.byu.edu/coca/files/100k_samples.txt
corpus.byu.edu/
corpus.leeds.ac.uk/list.html
books.google.co.uk/books?id=ja1_AAAAQBAJ&dq=word+frequency+coca&lr=
www.ling.helsinki.fi/kit/2009s/clt231/NLTK/book/ch01-LanguageProcessingAndPython.html
Great Zipf's law papers:
colala.bcs.rochester.edu/papers/piantadosi2014zipfs.pdf
www.ling.upenn.edu/~ycharles/sign708.pdf
arxiv.org/pdf/cond-mat/0412004.pdf
www-personal.umich.edu/~mejn/courses/2006/cmplxsys899/powerlaws.pdf
Zipf’s law articles and discussions:
www.theatlantic.com/magazine/archive/2002/04/seeing-around-corners/302471/
io9.com/the-mysterious-law-that-governs-the-size-of-your-city-1479244159?.Ej9760cOTJCPS_Bq4mjoww.0
plus.maths.org/content/os/latestnews/may-aug08/food/index
judson.blogs.nytimes.com/2009/05/19/math-and-the-city/?em
plus.maths.org/content/mystery-zipf?src=aop
www.datasciencecentral.com/profiles/blogs/why-zipf-s-law-explains-so-many-big-data-and-physics-phenomenons
en.wikipedia.org/wiki/Zipf%27s_law
books.google.co.uk/books?id=f8GrzlnMSm8C&pg=PA62&redir_esc=y#v=onepage&q&f=false
arxiv.org/pdf/0802.4393v1.pdf
www.pnas.org/content/108/9/3526.full
lewisdartnell.com/language_page.htm
wugology.com/zipfs-law/
other Zipf’s law PDFs
ftp.iza.org/dp3928.pdf
arxiv.org/pdf/1402.2965.pdf
arxiv.org/pdf/1104.3199.pdf
www.lel.ed.ac.uk/~jim/zipfjrh.pdf
www.ncbi.nlm.nih.gov/pmc/articles/PMC2834740/#pone.0009411-Mandelbrot1
polymer.bu.edu/hes/articles/pgs02a.pdf
in untranslated language: arxiv.org/pdf/0808.2904.pdf
pages.stern.nyu.edu/~xgabaix/papers/zipf.pdf
www.hpl.hp.com/research/idl/papers/ranking/ranking.html
statweb.stanford.edu/~owen/courses/306a/ZipfAndGutenberg.pdf
arxiv.org/pdf/1310.0448v3.pdf
www.kornai.com/Papers/glotto5.pdf
Zipf’s law slides:
www.slideshare.net/guest9fc47a/nlp-new-words
Pareto Principle and related ‘laws’:
www.squawkpoint.com/2013/03/pareto-principle/
billyshall.com/blog/post/paretos-principle
en.wikipedia.org/wiki/Pareto_principle
Random typing and Zipf:
www.longtail.com/the_long_tail/2006/09/is_zipfs_law_ju.html
health 80/20: archive.ahrq.gov/research/findings/factsheets/costs/expriach/expriach1.html
Principle of least effort:
en.wikipedia.org/wiki/Principle_of_least_effort
en.wikipedia.org/wiki/Satisficing
www.pnas.org/content/100/3/788.full.pdf [PDF]
csiss.org/classics/content/99
self organized criticality:
journal.frontiersin.org/article/10.3389/fnsys.2014.00166/full
Hapax Legomenon:
campus.albion.edu/english/2011/02/15/hapax-legomenon/
www.dailywritingtips.com/is-that-a-hapax-legomenon/
en.wikipedia.org/wiki/Hapax_legomenon
[PDF] www.aclweb.org/anthology/J10-4003
www.wired.com/2012/01/hapax-legomena-and-zipfs-law/
oed.hertford.ox.ac.uk/main/content/view/402/450/index.html#_ftn1
oed.hertford.ox.ac.uk/main/content/view/36/166/index.html
Learning curve: en.wikipedia.org/wiki/Learning_curve
Forgetting curve:
www.trainingindustry.com/wiki/entries/forgetting-curve.aspx
en.wikipedia.org/wiki/Forgetting_curve
Experience curve effects: en.wikipedia.org/wiki/Experience_curve_effects
Forgetting
and zipf's law: act-r.psy.cmu.edu/wordpress/wp-content/uploads/2012/12/37JRA_LS_PS_1991.pdf
public.psych.iastate.edu/shacarp/Wixted_Carpenter_2007.pdf
marshalljonesjr.com/youll-remember-less-than-001-of-your-life/
en.wikipedia.org/wiki/Forgetting
www.reddit.com/r/Showerthoughts/comments/3gu9qk/it_only_takes_three_generations_for_you_to_be/
music from:
rsloft.info
www.audionetwork.com

Коментара
  • Liam Binsfeld
    Liam Binsfeld

    Haha the

  • Eye Master 3.14
    Eye Master 3.14

    So, quizzaciously is a fun word, but can it beat fabaceous (Adv. of the nature of the bean)?

  • InsteadImAwake
    InsteadImAwake

    Quizzaciously

  • qwzerty_
    qwzerty_

    That intro is what makes time continue

  • Bernice Gardner
    Bernice Gardner

    The better quart enzymatically whistle because flugelhorn likely shade under a onerous care. boring, mushy link

  • Ultimate Flan
    Ultimate Flan

    11:27 top ten anime plot twists

  • afeelfortheflow with Manic
    afeelfortheflow with Manic

    This guy is extraordinary

  • Magic Beans
    Magic Beans

    AAAAAAAA! Vsauce is making me interested in math! NOOOOO What do I do lol

  • Cielo
    Cielo

    so if i study onlky 20% of most used words & grammar i can learn 80% of a language 🤑

  • A1 Helix
    A1 Helix

    This is like almost actual proof we are in a simulation

  • Vivek Saraswat
    Vivek Saraswat

    Since there are an infinite causes and effect pairs, I believe every arbitrary combination like 30/70 or 50/50 will also have infinite occurences (there may not be anything special about 20/80). If someone shows that the popularity or frequency of a particular combination, say 20/80, is more compared to the rest of the possibilities, then it would be something weird. Listing a 100 examples which follows 20/80 principle from an infinite more total examples does not lead me to believe that this combination is special. Nice video though, as always 😉.

  • Thomas Beasley
    Thomas Beasley

    We broke the law!!! Only 9 percent of plastic is recycled 91 percent is in landfills or is litter.

  • {Davidcool}
    {Davidcool}

    80% of my life is boring but 20% is more boring.

  • THE JACK HQ
    THE JACK HQ

    We have the Illuminati all figured out now 😏. They thought they could pull the Zipf over our eyes. Not so much anymore.

  • Hugo Petrarolha
    Hugo Petrarolha

    4:23 George Zipf é a cara do jornalista Augusto Nunes.

  • Eli Phelps
    Eli Phelps

    Vilfredo Pareto

  • Emlar Tubbs
    Emlar Tubbs

    i didnt understand any of that

  • RainMan
    RainMan

    Of all the stuff I have 20% is useful, 80% is junk..

  • DynaBlox
    DynaBlox

    the word "um" is used more than "the

  • Harvey YFBY
    Harvey YFBY

    80% of my code sucks and 20% of my code sucks whats the problem then

  • yash Payal
    yash Payal

    It made me sure that I am living in a stimulation: (

  • Cesar Arizpe
    Cesar Arizpe

    80% of micheals hair is on 20% of his head

  • God
    God

    maybe because we all run in one ai program

  • Carla Macias
    Carla Macias

    How can you not translate the unknown language, all ya gotta do is figure out what's used the most then that must be the word "the" and so on.

  • jisdaboss1
    jisdaboss1

    All this tells me is that life is actually just a lot of annoying math problems I don't want to do

  • That Guy
    That Guy

    Why do I only watch vsauce at 5 in the morning

  • Jonathan Shedd
    Jonathan Shedd

    Zipfs law seems like an Easter egg the creators of the world put in when they were designing us, in the simulation, we're just part of a simulation created by other beings and they made things like zipfs law intentionally for us to eventually find. Imagine the things we don't yet know, or even better imagine the things we think we know but are just based off of speculation

    • BFB-DanceySteve
      BFB-DanceySteve

      Speculation? Oh, you mean like speculation as in there must be a creator

  • Alex Wall
    Alex Wall

    He is so quizacious

  • Tarik Tezcan
    Tarik Tezcan

    Someone should do this for the 3 holly books. Just for fun.

  • Dead Man
    Dead Man

    Cycloid ... 🙌🏽

  • Asif Molvi
    Asif Molvi

    @Vsauce

  • Asif Molvi
    Asif Molvi

    @vsauce please make a video of benfords law

  • xxxgammaxxx
    xxxgammaxxx

    I got through about half of this video.

  • billy watkins
    billy watkins

    That was until this new generation. Now it seems that every other word is "like".

  • T. L.
    T. L.

    80% of my life has been wasted on 20% success.

  • DJ matexx
    DJ matexx

    Zipf's law treats statistics quizzatiously.

  • Parallax WR
    Parallax WR

    80 percent of diamonds are mined by 20 percent of players

  • The Tattoo Trunk Show with Scott Hill
    The Tattoo Trunk Show with Scott Hill

    I vote that we all copy paste the word sauce over and over and throw off the whole Zipf thing off. It will be Anarchy. Cats living with dogs. I’m an evil genius. sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce I said off twice just for fun.

  • Paige Bell
    Paige Bell

    This just proves whoever is running the simulation got lazy on some details lol

  • Axel de Water
    Axel de Water

    I almost clicked on another video when he did the fake ending.

  • SandyRiverBlue
    SandyRiverBlue

    I'm curious what effect the application of anti-trust laws has on these distributions. We know that when we apply these laws it tends to improve the economy and the quality of life for the customers of these companies. But if businesses tend toward this equilibrium of unfairness then a more heavy handed a approach might be warranted.

  • Wallijacanero
    Wallijacanero

    "Even so, they have made me" I love this sentence. I lost my grandfather almost a month ago and he was the one who was truly passionate about studying. He had inspired me to continue my studies after high school and I am still passionate about studying. I've been thinking a lot of him during this month, but I realized I was and am not able to remember much things about him as I would like to. Probably this link doesn't make sense, but that sentence Michael said here makes me feel better about it. Thank you.

  • Ana Burke
    Ana Burke

    The decisive development comparably tease because pail similarly return round a lewd bead. scandalous, deadpan hardboard

  • Bernard chezmond dinglechalk
    Bernard chezmond dinglechalk

    What if the zipfs law thing isn’t a flaw in the world but a flaw in how we record and measure the world

  • Jonah Maddocks
    Jonah Maddocks

    Confused unga bunga

  • rwfrench66
    rwfrench66

    Mandarin has no translation for "the" Mikey! They also use use less polite words in common language. Like, you wouldn't ask a waitress, "Could I have the check please?" you would say, "Bring check now!" as far as a literal translation goes. It's not considered rude, that's just how that culture speaks. People learning Mandarin might use formal words like please and it will usually make a native Mandarin speaker laugh or at least smile because it seems odd to them.

  • Random User
    Random User

    Can't I ruin this whole thing by going to Wikipedia and typing sauce 100000 times and publish it? If you say that wouldn't be counted what if I just say it in real life 100000 times, then it has appeared so you have to count it... Can this just be completely thrown off?

  • Doubledge11
    Doubledge11

    As a nurse I wonder what the most common words I use in the hospital are? Maybe they are still the usual suspects

  • Peregrine
    Peregrine

    I don't really have an opinion on whether or not we live in a simulation, but I would accept that Zipf's Law is the result of a low-level algorithm trying to simulate randomness.

  • Smudged Out
    Smudged Out

    the word frequency and rank thing is weird to me cause it seems like that's not even really true?? I've only seen about the first minute of the video but when he shows the Shakespeare graphic at 1:17, the 1/2, 1/3, 1/4 thing doesn't happen at all, it goes 1st "and" (~650), 2nd "the" (~650), 3rd "I" (~575) and trends downward for the rest of it. I agree the graph looks like a 1/x graph, but it's not like as the word rank goes from 1 to 2 it halves. The rest of the graph follows the trend, but the beginning of it (the most interesting part of it) doesn't even really do it

    • Smudged Out
      Smudged Out

      As I'm watching the rest of the video, the other examples still hold up, it's just weird that the first example they chose to show didn't actually show it

  • QvQ
    QvQ

    Who else remembers their locker number? Mines 16,18,37

  • Schippai
    Schippai

    Huh, I can't believe it's been 5 years since this came out. I distinctly remember this video, alongside the "Banach Tarski Paradox" video.

  • Nathan Motoyama
    Nathan Motoyama

    Someone has to count how many times Michael says “the” to figure out the secret number to unlocking the secrets of the universe

  • Santa Reviews
    Santa Reviews

    20% of my reindeer do 80% of the flying 🎄🦌

  • Kuwaitisnot adeployment
    Kuwaitisnot adeployment

    100% of my problems are caused by one woman so.......

  • Maggie Hough
    Maggie Hough

    brb gonna go put the entire script into a google doc then a google form rip sleep 😀

  • joe squire
    joe squire

    im sorry but how is sauce 5,555 and cheltenham is 5,556 in the great british language index

  • Dwayne Mair
    Dwayne Mair

    Are you sure a person can make a sentence without it. Most used word, please.

  • Shafiq
    Shafiq

    The the the the the the

  • J Garbo
    J Garbo

    Thai has no articles, or plurals, or gender pronouns. Oh dear...You should get out more.

  • MetaReaper zippidy do da
    MetaReaper zippidy do da

    Can some count the number of "the" in the video

  • BergBerg
    BergBerg

    Combine this with the Brachistochrone video and one might assume that 80% of the acceleration is done over the first 20% of the distance.

  • Vitor
    Vitor

    how does this relate to bendford's law?

  • fetterFisch
    fetterFisch

    0:03-0:13 haha I'm german

  • Shubham Singh
    Shubham Singh

    Ever heard of benforrd's law ? Its the same thing

  • Alex B.
    Alex B.

    QUIZZACIOUSLY!

  • Rebecca Rachel
    Rebecca Rachel

    Omg wow

  • Alpha Delta
    Alpha Delta

    I'd personally say this is one of the most significant videos on the Internet. I spent a couple of months once just looking into this phenomenon and it is very interesting.

  • yatharth saxena
    yatharth saxena

    The simulation in which we run has some laws in its code like zipfs, some series like fibonacci and then the neural network trained to almost 99.99% put that into everything - it proves we're in a simulation

  • VaQMNRG
    VaQMNRG

    Between infinite periodicals like pi and eulers number, and zipfs law... not too far off thinking someone is simulating reality for the fuck of it

  • Lois Ray McInnis
    Lois Ray McInnis

    Thelongestwordinthe dictionary is: ANTIDISASTABLISHMENTARIANISM;ha! ha!

  • joe mama
    joe mama

    proof of the matrix

  • sloma111
    sloma111

    Answer - more common than word "ask". Opposite to what was said.

  • random boi
    random boi

    80% of Vsauce videos were uploaded in a span of 20% of his youtube journey And as always thanks for reading :)

  • Leonardo Zilmar
    Leonardo Zilmar

    80% of what i remember is 20% of my whole memory

  • Rusty Ralston
    Rusty Ralston

    man ....so many story ideas i forgot

  • WhatThuSmell
    WhatThuSmell

    WAIT. Another thing, 80 percent of the money in america.... is held by..... oh wait, that's the top 1%.

  • Pramod Bisht
    Pramod Bisht

    Michael's Age 34

  • Mojo 2K
    Mojo 2K

    My favorite meat is 80-20

  • John Barnes
    John Barnes

    This is one of the many videos I've watched that in total helped me get to the solutions I was so desperately grasping at

  • Joan Clayton Johnson
    Joan Clayton Johnson

    We really are in the matrix.

  • -
    -

    Dear friends, please watch this video and just think about what has been said. This man speaks the truth rsloft.info/loft/video/Z5eayqDR0X-sfmk

  • Kyle Dailey
    Kyle Dailey

    *When fact checking Zipf's law was really true, I found that 80% of the time, it wasn't true, 20% it was true.* Check it yourself. *When fact checking Zipf's law was really true, I found that 80% of the time, it wasn't true, 20% it was true.*

  • Kyle Dailey
    Kyle Dailey

    _20% of this is true to reality, 87% is horse shit_

  • Gurkirpal Singh
    Gurkirpal Singh

    The

  • Leon Dupe
    Leon Dupe

    @4:30 I realized The "Pareto principle" looks identical to the "Brachistocrone curve" 🤔🤷‍♂️🤯

  • FirstName LastName
    FirstName LastName

    @Mumbo Jumbo your unease may simply be a result of the incredibly annoying nature of the speaker. OR, your unease is the result of discovering we are living in a simulation

  • Jack Gibson
    Jack Gibson

    I thought it’d be like tbh

  • The Samdroid Online
    The Samdroid Online

    Is this proof we are living in The Matrix?

  • Duck Bob
    Duck Bob

    Just realized that answer is right before questions in the word frequency counter

  • Theodore J. Burkhardt
    Theodore J. Burkhardt

    I’be learned more from watching this channel than 3 years of middle school

    • OldSchool Vines
      OldSchool Vines

      Bro ikr same

  • Daniel Peixoto Martins
    Daniel Peixoto Martins

    That's so easy to explain! That's because of the

  • ZX polo
    ZX polo

    our whole life can be predicted, and we are just a part of this system that creates random personalities combined with random physical appearances, which are put in random situations, over and over again, so in theory, There is a big possibility that there someone that has very much similar features, in all aspectives, but that is not possible to happen if it was not on the same time period or "culture/society and enviromental affects" , being that because the experiences with society in which form personality will be different... so is "god" just creating different human beings and putting them in different situations for entertainment, are we living in order to test every possible possibility until we get somewhere?

    • ZX polo
      ZX polo

      oh my god, I was thinking about what I said, and well we have already proof of it, like why do asian people have different features and mostly different "life experinces" then african american for example, why is it not just mixed everywhere? why do we HUMANS, like to segregate alike things? humans have to learn that we are EMPTY OF INHERENT VALUE, and we should not feel like we HAVE to represent something/where/who because of what society expects or because you think you will not be "you" without that, because there is no real you, we will always adapt and change.

  • ZX polo
    ZX polo

    So basically EVERYTHING is partially predictable!!!!

  • Smoker Noyz
    Smoker Noyz

    much love

  • pandazbox
    pandazbox

    These videos help me sleep because knowing more facts help me be comforted.

  • rocker boi
    rocker boi

    I don't remember anything

  • gaemez
    gaemez

    i watch 80% of vsauce videos and understand 20%

  • Chuck Itall
    Chuck Itall

    I had my lawyer and hers argue over the word "the" used in a sentence in our custody battle for at least an hour,, at 200 bucks an hour a piece,, we both decided to agree... I think it was there plan but they just stretched out the act.

  • sangwoo chan
    sangwoo chan

    saice is the 5555th most common word nioce 😏

    • sangwoo chan
      sangwoo chan

      sauce