The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza

Page created by Dave Vaughn
 
CONTINUE READING
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
The Incredible Methamorphosis of
   The computer in Smartphone

    L’incroyable métamorphose de
      l’ordinateur en smartphone

               Prof. David Atienza
Embedded Systems Laboratory (ESL),
 Section of EE, Faculty of Engineering
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
The origin of the smartphone:
                      Embedded Systems

 Traditionally: Very tight constraints and
  resources, but limited functionality
  •   Washing machines
  •   Refrigerators
  •   Recording units, etc.
  •   …

 ASICs or simple microcontrollers
 (8-bit PIC MB95F204K or 16-bit microcontrollers)

                                                         2
                              David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
But today…

 Everywhere: « active » part in our life
    • Cameras, MP3 players, portable video, …

   Smartphone: digital convergence in embedded systems
    •   One device, but multiple functions

                                                          Entertainment
          Communication

                                                            Broadcasting
           Computing

              Imaging                                      Telematics
                                                                           3
                               David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
But today…

 Everywhere: « active » part in our life
    • Cameras, MP3 players, portable video, …

   Smartphone: digital convergence in embedded systems
    •   One device, but multiple functions

                                                          Entertainment
              It changes drastically what we need to
          Communication

                           explain in ECE:
                                           Broadcasting
                  How to design « smart systems
           Computing                                   »
                     (like the « smart phone »)
              Imaging                                      Telematics
                                                                          4
                               David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
Computing Systems: The Origins
 “Stored program architecture” (Von Neumann Architecture)
   • 1945, by John Von Neumann (mathematic, physics,
               economics, computer science, and statistics)
 Only 3 components to create a “digital computer”
   1. Processing unit with arithmetic logic unit and registers.
       • Control unit: instruction register and program counter
   2. Memory: storing data and instructions / Input, output (I/O) devices
   3. Interconnection (bus)

                                                                    I/O
                            PROCESSING UNIT (PU)
                                                                  DEVICES
                            Arith. Logic unit

                                                           Bus
                                                   Regs.
                                 (ALU)
                                                                 MEMORY
                                                                 Instruction 0
                             CONTROL UNIT (CU)                   Instruction 1
                         Cont. Prog.                              …
                                        Reg. Instr. (IR)         Data 0, 1, …
                         (PC)
                                                                                 5
                            David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
Computing Systems: The Origins
 “Stored program architecture” (Von Neumann Architecture)
   • 1945, by John Von Neumann (mathematic, physics,
               economics, computer science, and statistics)
 Only 3 components to create a “digital computer”
   1. Processing unit with arithmetic logic unit and registers.
       • Control unit: instruction register and program counter
   2. Memory: storing data and instructions / Input, output (I/O) devices
   3. Interconnection (bus)

                                                                     I/O
                             PROCESSING UNIT (PU)
                                                                   DEVICES
                             Arith. Logic unit

                                                            Bus
                                                    Regs.
                                  (ALU)
                                                              MEMORY
                                                              Instruction 0
               Manchester Small-Scale Experimental Machine (SSEM),
                            CONTROL
                       nicknamed     UNIT (CU)
                                  “Baby”   [June 21st, 1948]  Instruction 1
                          Cont. Prog.                             …
                                         Reg. Instr. (IR)         Data 0, 1, …
                          (PC)
                                                                                 6
                             David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
How did computers evolve after BABY?
                             “I think there is a world market for
                              maybe 5 computers” T. Watson – IBM,
                              1949
                             “There is no reason anyone would
                              want a computer in their home” K.
                              Olsen – DEC 1977
 1958: 1st integrated circuit (IC) – Jack Kilby
    2000 Nobel Prize in Physics
    2007 – IEEE Milestone

 1965: “Moore’s Law” – Gordon E. Moore, Intel co-founder
    The number of components in ICs had doubled every year from the
     invention of the integrated circuit in 1958 until 1965 and predicted
     that the trend would continue "for at least ten years”…
                                                                        7
                             David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
Microprocessor architectures: Evolution to
           microprogrammed embedded systems
   Microprocessor have evolved since Nov. 15th, 1971 towards more complex
    functionality and performance, but at a cost of power…
    0.3 Watts                                                  95-130 Watts!
-                                    Complexity                                  +
           Intel 4004 [1971]                           Intel Xeon [2006-]
           (2250 p-MOS trans., 108 KHz,                (820M trans., 3.73GHz,
           4-bit,mem.:640B)                            64-bit, mem.:4MB/L2)

          Busicon Calculator 141-PF           Intel Many Integrated Core (MIC) [2011]
                                                                                     8
                                David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
No More “Free” Energy ? Voltage scaling
                               stopped!

  1 transistor = 1x energy   2 transistors = 1x energy   4 transistors = 1x energy

 Before (1970~2000) – R. Dennard Scaling Theory (1974)
    Used to make transistors smaller
    Smaller transistors less electricity to operate

 Now (actually since 2000-):
    Continue to make transistors smaller
    But, each of them uses similar electricity…
     WE CANNOT “JUST PUT ALTOGETHER”

                                                                                 9
                              David Atienza (ESL/EPFL)
The Incredible Methamorphosis of The computer in Smartphone L'incroyable métamorphose de l'ordinateur en smartphone - Prof. David Atienza
Microprocessor architectures: Evolution to
           microprogrammed embedded systems
   Microprocessor have evolved since Nov. 15th, 1971 towards more complex
    functionality and performance, but at a cost of power…
    0.3 Watts                                                  95-130 Watts!
-                                    Complexity                                +
           Intel 4004 [1971]                          Intel Xeon [2006-]
           (2250 p-MOS trans., 108 KHz,               (820M trans., 3.73GHz,
           4-bit,mem.:640B)                           64-bit, mem.:4MB/L2)

        Principles remain, so in new embedded systems it is key a new metric:
                 MIPS/Watt New opportunities for EPFL engineers!
           Busicon Calculator 141-PF      Intel Many Integrated Core (MIC) [2011]
                                                                                   10
                               David Atienza (ESL/EPFL)
Handle “smartphone-like” systems

    Using Advanced RISC Machines Ltd (ARM), founded in 1990
    Building “smartphone-like systems”:
      1. Proc. unit: ARM cores
      2. I/O devices: many, many…
      3. Interconnection:
           Communication Wireless
           (to other systems as key
           as within the systems)

                                      Wii console, Nov. 2006

                                                               Nintendo 3DS,
                                                               Feb. 26, 2011
    By Jan. 2012, 19 Billion ARM cores shipped,
    Best sellers: ARM9 and ARM7TDMI
                                                                               11
                                  David Atienza (ESL/EPFL)
Automotive electronics market size
            Cost of Electronics / Car ($)
   1400
   1200
   1000
    800                                                        2011: The cost of silicon in
    600                                                          a car is higher than the
    400                                                          cost of steel [EEtimes]
    200
      0
             1998       1999       2000       2001       2002       2003     2004     2005

   Market
            8.9         10.5       13.1       14.1      15.8       17.4     19.3     21.0
($billions)

          “70% of future innovations in our vehicles will be only possible through
                  improvements of the embedded electronic systems”
                                                       [Design and Development at Ferrari]

                                                                                             12
                                    David Atienza (ESL/EPFL)
But also in “traditional” consumer/home
                    applications…

“22% of all TVs shipped worldwide in 2010 were Network-enabled;
 25M units in 2010 and 122M expected in 2014 (approximately 75%)”
                                                 [TechNews, Dec. 2010]
                                                                         13
                      David Atienza (ESL/EPFL)
New Computer Engineering at SEL-EPFL
                (Third Year Bachelor in EE)

 Study the new « smartphone »
  architectures:
  • Microprocessors of 32 bits, memories,
    bluetooth, buttons, touchscreen, wifi,
    sound, etc.
 But with «real smartphone systems»:
  Nintendo Development System (DS)

                                             ARM946E-S    ARM7TDMI-S

                                                                       14
                               David Atienza (ESL/EPFL)
Examples of student projects with Nintendo DS

 PictoMania (Chloé Weber et Mina Bjelogrlic)

                                                     15
                        David Atienza (ESL/EPFL)
Examples of student projects with Nintendo DS

 Kongey Donk (Niloufar Alipour Therani et Matthias Lambert)

                                                               16
                        David Atienza (ESL/EPFL)
Examples of student projects with Nintendo DS

 DS Tron (Niklaus Lehmann et Adrian Hauswirth)

                                                    17
                       David Atienza (ESL/EPFL)
Examples of student projects with Nintendo DS

 DS Tron (Niklaus Lehmann et Adrian Hauswirth)

                                                    18
                       David Atienza (ESL/EPFL)
Course evaluation… Also with « bonus»

 Competition in groups of two at end of semester:
  Kit Nintendo DS for the winning team/s
     Nintendo DS
     Charger(Swiss/Europe)
     MicroSD memory card and adapter
     Nintendo DS box

                                                      19
                           David Atienza (ESL/EPFL)
Course evaluation… Also with « bonus»

 Competition in groups of two at end of semester:
  Kit Nintendo DS for the winning team/s
     Nintendo DS
     Charger(Swiss/Europe)
     MicroSD memory card and adapter
     Nintendo DS box

                                                      20
                           David Atienza (ESL/EPFL)
Examples of student projects with Nintendo DS

 OSC-based Sequencer (Luis Gaemperle et Michael Tschannen)

                                                          WiFi AP

                                     Wireless
                                OSC – MIDI Translator
     Sequencer GUI
                                                        MIDI Instruments
                                                                           21
                      David Atienza (ESL/EPFL)
Projets à l’EPFL par des ingénieurs électriciens en
                systèmes embarqués microprogrammés

 Projet d’un système embarqué pour “healthy lifestyle” et fitness
  avec capteurs et la Nintendo DS
 Et aussi possible avec l’iPhone plus tard!
    Capteurs ECG et accéléromètre sans fils

                                                                     22
                              David Atienza (ESL/EPFL)
New smart ECG monitors have considerable
        resonance in the media and the medical community

Non-intrusive, light
and operates for 4
weeks for a single
 battery recharge
                                                     23
                       David Atienza (ESL/EPFL)
New smart ECG monitors have considerable
        resonance in the media and the medical community
 Multiple applications, just a few:
   Sleep apnea detection
   Pilot monitoring
   Wolf detection!

                                                 With Chuv and HES-VS

                                                                        24
                      David Atienza (ESL/EPFL)
Dynamically Configurable Multi-Camera
                System-Level Design for 3D Video
                                   Front view of
                                9-camera & reconf.
                                 prototype (cheap
                                640x480 sensors)

                                                           With dynamic reconfiguration
        Used for 3D filming Montreux Jazz festival in 2011-2012

• 9-camera system architecture
    • Use of 9 cameras-FPGAs and 2nd
    level concentrator at the bottom
    • Dynamic set of hardware accelerators
    dynamically loaded
• Ultra-high resolution & adv. effects
    • Able to record 1024x768 at 90 frames
    • Advanced effects: large zoom, track
    objects autonomously, etc.                                                       25
                                David Atienza (ESL/EPFL)
Conclusion

Teaching EE and CE has changed
   with the “smartphones era”
             Thanks! Questions?

See video of Embedded Systems Lab. (ESL) activities at SEL-EPFL at :
http://www.youtube.com/watch?feature=player_embedded&v=AFFhfQxPepI

                                                                  26
You can also read