World Library  
Flag as Inappropriate
Email this Article

Learning curve

Article Id: WHEBN0000322337
Reproduction Date:

Title: Learning curve  
Author: World Heritage Encyclopedia
Language: English
Subject: Swanson's law, Experience curve effects, Learning curve (disambiguation), New users, FOAK
Collection: Cognitive Science, Curves, Learning
Publisher: World Heritage Encyclopedia

Learning curve

A learning curve is a graphical representation of the increase of learning (vertical axis) with experience (horizontal axis).

Learning curve for a single subject, showing how learning improves with experience
A learning curve averaged over many trials is smooth, and can be expressed as a mathematical function

The term learning curve is used in two main ways: where the same task is repeated in a series of trials, or where a body of knowledge is learned over time. The first person to describe the learning curve was Hermann Ebbinghaus in 1885, in the field of the psychology of learning, although the name wasn't used until 1909.[1][2] In 1936, Theodore Paul Wright described the effect of learning on production costs in the aircraft industry.[3] This form, in which unit cost is plotted against total production, is sometimes called an experience curve.

The familiar expression "a steep learning curve" is intended to mean that the activity is difficult to learn, although a learning curve with a steep start actually represents rapid progress.[4][5]


  • In psychology 1
  • In economics 2
  • Examples and mathematical modelling 3
  • In machine learning 4
  • Broader interpretations 5
  • General learning limits 6
  • In culture 7
    • "Steep learning curve" 7.1
    • "ON a steep learning curve" 7.2
  • See also 8
  • References 9
  • External links 10

In psychology

The first person to describe the learning curve was Hermann Ebbinghaus in 1885. His tests involved memorizing series of nonsense syllables, and recording the success over a number of trials. The translation does not use the term learning curve—but he presents diagrams of learning against trial number. He also notes that the score can decrease, or even oscillate.[5][6][7]

The first known use of the term learning curve is from 1909 : "Bryan and Harter (6) found in their study of the acquisition of the telegraphic language a learning curve which had the rapid rise at the beginning followed by a period of retardation, and was thus convex to the vertical axis."[2][5]

Psychologist Arthur Bills gave a more detailed description of learning curves in 1934. He also discussed the properties of different types of learning curves, such as negative acceleration, positive acceleration, plateaus, and ogive curves. (Fig 1)[8]

In economics

In 1936, Theodore Paul Wright described the effect of learning on production costs in the aircraft industry and proposed a mathematical model of the learning curve.[3]

In 1968 Bruce Henderson of the Boston Consulting Group (BCG) generalized the Unit Cost model pioneered by Wright, and specifically used a Power Law, which is sometimes called Henderson's Law. He named this particular version the experience curve.[9][10] Research by BCG in the 1970s observed experience curve effects for various industries that ranged from 10 to 25 percent.[11]

The economic learning of productivity and efficiency generally follows the same kinds of economic growth, as discussed in the Jevons paradox in the 1880s and updated in the Khazzoom-Brookes Postulate in the 1980s.

Examples and mathematical modelling

A learning curve is a plot of the increase of learning (or proficiency) with experience.

  • The Horizontal Axis represents experience either directly as time (clock time, or the time spent on the activity), or can be related to time (a number of trials, or the total number of units produced).
  • The Vertical Axis represents learning or proficiency. It can either be increasing (for example, the score in a test), or decreasing (the time to complete a test). (Fig 3)

For the performance of one person in a series of trials the curve can be erratic, with proficiency increasing, decreasing or leveling out in a plateau. (Fig 1)

When the results of a large number of individual trials are averaged then a smooth curve results, which can often be described with a mathematical function. (Fig 2)

Fig 4: Exponential growth 
Fig 5 : Exponential rise or fall to a limit 
Fig 6 : Power Law 
Fig 7 : S-Curve or Sigmoid Function 

Several main functions have been used:[12][13][14]

  • Exponential growth
The proficiency can increase without limit, as in Exponential growth (Fig 4)
  • Exponential rise or fall to a Limit
Proficiency can exponentially approach a limit in a manner similar to that in which a capacitor charges or discharges (Exponential decay) through a resistor. (Fig 5)
The increase in skill or retention of information is sharpest during the initial attempts, and then gradually levels out, meaning that the subject's skill does not improve much with each repetition, or that less new knowledge is gained over time.
This is similar in appearance to an Exponential decay function, and is almost always used for a decreasing performance metric, such as cost. (Fig 6) It also has the property that if you plot the logarithm of proficiency against the logarithm of experience the result is a straight line, and it is often presented that way. (Fig 8)
Fig 8. Experience curve shown in linear-linear and log-log forms
The specific case of a plot of Unit Cost versus Total Production with a Power Law was named the Experience Curve: the mathematical function is sometimes called Henderson's Law.
This form of learning curve is used extensively in industry for cost projections.[15]
In this case the improvement of proficiency starts slowly, then increases rapidly, and finally levels off. (Fig 7)

The page on "Experience curve effects" offers more discussion of the mathematical theory of representing them as deterministic processes, and provides a good group of empirical examples of how that technique has been applied.

In machine learning

Plots relating performance to experience are widely used in machine learning. Performance is the error rate or accuracy of the learning system, while experience may be the number of training examples used for learning or the number of iterations used in optimizing the system model parameters.[16] The machine learning curve is useful for many purposes including comparing different algorithms,[17] choosing model parameters during design,[18] adjusting optimization to improve convergence, and determining the amount of data used for training.[19]

Broader interpretations

Initially introduced in management of group learning, among other fields.[20] These processes of rapidly emerging new form appear to take place by complex learning within the systems themselves, which when observable, display curves of changing rates that accelerate and decelerate.

General learning limits

Learning curves, also called experience curves, relate to the much broader subject of natural limits for resources and technologies in general. Such limits generally present themselves as increasing complications that slow the learning of how to do things more efficiently, like the well-known limits of perfecting any process or product or to perfecting measurements.[21] These practical experiences match the predictions of the second law of thermodynamics for the limits of waste reduction generally. Approaching limits of perfecting things to eliminate waste meets geometrically increasing effort to make progress, and provides an environmental measure of all factors seen and unseen changing the learning experience. Perfecting things becomes ever more difficult despite increasing effort despite continuing positive, if ever diminishing, results. The same kind of slowing progress due to complications in learning also appears in the limits of useful technologies and of profitable markets applying to product life cycle management and software development cycles). Remaining market segments or remaining potential efficiencies or efficiencies are found in successively less convenient forms.

Efficiency and development curves typically follow a two-phase process of first bigger steps corresponding to finding things easier, followed by smaller steps of finding things more difficult. It reflects bursts of learning following breakthroughs that make learning easier followed by meeting constraints that make learning ever harder, perhaps toward a point of cessation.

  • Natural Limits One of the key studies in the area concerns diminishing returns on investments generally, either physical or financial, pointing to whole system limits for resource development or other efforts. The most studied of these may be Energy Return on Energy Invested or EROEI, discussed at length in an Encyclopedia of the Earth article and in an OilDrum article and series also referred to as Hubert curves. The energy needed to produce energy is a measure of our difficulty in learning how to make remaining energy resources useful in relation to the effort expended. Energy returns on energy invested have been in continual decline for some time, caused by natural resource limits and increasing investment. Energy is both nature's and our own principal resource for making things happen. The point of diminishing returns is when increasing investment makes the resource more expensive. As natural limits are approached, easily used sources are exhausted and ones with more complications need to be used instead. As an environmental signal persistently dimishing EROI indicates an approach of whole system limits in our ability to make things happen.
  • Useful Natural Limits EROEI measures the return on invested effort as a ratio of R/I or learning progress. The inverse I/R measures learning difficulty. The simple difference is that if R approaches zero R/I will too, but I/R will approach infinity. When complications emerge to limit learning progress the limit of useful returns, uR, is approached and R-uR approaches zero. The difficulty of useful learning I/(R-uR) approaches infinity as increasingly difficult tasks make the effort unproductive. That point is approached as a vertical asymptote, at a particular point in time, that can be delayed only by unsustainable effort. It defines a point at which enough investment has been made and the task is done, usually planned to be the same as when the task is complete. For unplanned tasks it may be either foreseen or discovered by surprise. The usefulness measure, uR, is affected by the complexity of environmental responses that can only be measured when they occur unless they are foreseen.

In culture

"Steep learning curve"

The expression steep learning curve is used with opposite meanings. The term is often used in common English with the meaning of a difficult initial learning process.[5][22] Nevertheless, the Oxford English Dictionary, the American Heritage Dictionary of the English Language, and Merriam-Webster’s Collegiate Dictionary define a learning curve as the rate at which skill is acquired, so a steep increase would mean a quick increment of skill.[4][22]

Arguably, the common English use is due to metaphorical interpretation of the curve as a hill to climb. (A steeper hill is initially hard, while a gentle slope is less strainful, though sometimes rather tedious. Accordingly, the shape of the curve (hill) may not indicate the total amount of work required. Instead, it can be understood as a matter of preference related to ambition, personality and learning style.)

Fig 9 : Short and long learning curves 
Fig 10 : Product A has lower functionality and a short learning curve. Product B has greater functionality but takes longer to learn 

The term learning curve with meanings of easy and difficult can be described with adjectives like short and long rather than steep and shallow.[4] If two products have similar functionality then the one with a "steep" curve is probably better, because it can be learned in a shorter time. (Fig 9) On the other hand, if two products have different functionality, then one with a short curve (a short time to learn) and limited functionality may not be as good as one with a long curve (a long time to learn) and greater functionality. (Fig 10)

For example, the Windows program Notepad is extremely simple to learn, but offers little after this. On the other extreme is the UNIX terminal editor VI or Vim, which is difficult to learn, but offers a wide array of features to master after the user has figured out how to work it.[23]

"ON a steep learning curve"

Ben Zimmer discusses the use of the term "ON a steep learning curve" in an article "A Steep Learning Curve" for Downton Abbey, concentrating mainly on whether it is an anachronism. "Matthew Crawley, the presumptive heir of Downton Abbey and now the co-owner of the estate, says, 'I've been on a steep learning curve since arriving at Downton.' By this he means that he's had a difficult time learning the ways of Downton. Unfortunately, people didn't start talking that way until the 1970s."[5][24][25]

Zimmer also comments that the popular use of steep as difficult is a reversal of the technical meaning. He identifies the first use of steep learning curve as 1973, and the arduous interpretation as 1978.

See also


  1. ^ Page 42, Fig 2
  2. ^ a b The American Journal of Psychology, Volume 14 1903 By Granville Stanley Hall, Edward Bradford Titchene
  3. ^ a b Wright, T.P., "Factors Affecting the Cost of Airplanes", Journal of Aeronautical Sciences, 3(4) (1936): 122–128.
  4. ^ a b c "Laparoscopic Colon Resection Early in the Learning Curve", Ann Surg. 2006 June; 243(6): 730–737, see the "Discussions" section, Dr. Smith's remark about the usage of the term "steep learning curve": "First, semantics. A steep learning curve is one where you gain proficiency over a short number of trials. That means the curve is steep. I think semantically we are really talking about a prolonged or long learning curve. I know it is a subtle distinction, but I can't miss the opportunity to make that point."
  5. ^ a b c d e Ben Zimmer, February 8, 2013
  6. ^ Classics in the history of psychology
  7. ^ page 42, Fig 2
  8. ^ Bills, A.G. (1934). General experimental psychology. Longmans Psychology Series. (pp. 192-215). New York, NY: Longmans, Green and Co.
  9. ^ BCJ 1968
  10. ^ Grant, Robert M. (2004), Contemporary strategy analysis,  
  11. ^ Hax, Arnoldo C.; Majluf, Nicolas S. (October 1982), "Competitive cost dynamics: the experience curve", Interfaces 12 (5): 50–61,  
  12. ^ Mechanisms of skill acquisition and the law of practice Newell 1980
  13. ^ Ritter, F. E., & Schooler, L. J. The learning curve. In International Encyclopedia of the Social and Behavioral Sciences (2002), 8602-8605. Amsterdam: Pergamon
  14. ^
  15. ^ Department of Defense Manual Number 5000.2-M, mandates the use of learning curves for costing of defense programs (variable costs of production)
  16. ^ Sammut, Claude; Webb, Geoffrey I. (Eds.). Encyclopedia of Machine Learning (1st ed.). Springer. p. 578.  
  17. ^ Madhavan, P.G. (Vol. 7, 1-2, 1997). "A New Recurrent Neural Network Learning Algorithm for Time Series Prediction" (PDF). Journal of Intelligent Systems. p. 113 Fig. 3. 
  18. ^ "Machine Learning 102: Practical Advice". Tutorial: Machine Learning for Astronomy with Scikit-learn. 
  19. ^ Meek, Christopher; Thiesson, Bo; Heckerman, David (Summer 2002). "The Learning-Curve Sampling Method Applied to Model-Based Clustering". Journal of Machine Learning Research 2 (3): 397. 
  20. ^ Connie JG Gersick 1991 "Revolutionary Change Theories: A Multilevel Exploration of the Punctuated Equilibrium Paradigm" The Academy of Management Review, Vol. 16, No. 1 pp. 10-36 1
  21. ^ "Towards the Limits of Precision and Accuracy in Measurement". 
  22. ^ a b "Steep learning curves". 
  23. ^ Apparently from Code Editor Learning Curves SteveRowe 17 Nov 2004 7:59 PM
  24. ^ "Downton Abbey" anachronisms: beyond nitpickery, Ben Zimmer, February 13, 2012
  25. ^ Comment by J Oliver : Season Three, episode 5

External links

  • Learning curve
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.

Copyright © World Library Foundation. All rights reserved. eBooks from World eBook Library are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.