SlideShare a Scribd company logo
1 of 75
Download to read offline
Creating Responsive
     HTML5 Touch
     Interfaces
     Stephen Woods




Sunday, March 11, 12
Stephen Woods
                       Front End Engineer
                              Flickr




Sunday, March 11, 12
Sunday, March 11, 12
On the desktop we
       worry about browsers
         -moz-transform:rotate(-270deg);
         -moz-transform-origin: bottom left;
         -webkit-transform: rotate(-270deg);
         -webkit-transform-origin: bottom left;
         -o-transform: rotate(-270deg);
         -o-transform-origin: bottom left;
         filter:progid:DXImageTransform.Microsoft
         .BasicImage(rotation=1);

Sunday, March 11, 12
On mobile we worry
                about devices.


Sunday, March 11, 12
Wait!
                   Did you say they all
                       run webkit?



Sunday, March 11, 12
Wait!
                   Did you say they all
                       run webkit?



Sunday, March 11, 12
Wait!
                   Did you say they all
                       run webkit?



Sunday, March 11, 12
                                 X
On mobile we worry
                about devices.


Sunday, March 11, 12
Screen
     Sizes
     Media Queries,
     Break points,
     liquid layouts




   http://www.alistapart.com/articles/responsive-web-design/
Sunday, March 11, 12
Sunday, March 11, 12
iPhone 3GS
                        256mb RAM
                       Geekbench: 271




Sunday, March 11, 12
iPhone 3GS
                        256mb RAM
                       Geekbench: 271



                             ==



Sunday, March 11, 12
Modern mobile
                  devices are crappy
                    computers with
                  decent video cards.

Sunday, March 11, 12
Sunday, March 11, 12
Perceived
         Performance
Sunday, March 11, 12
On the desktop it’s
      easy...



                       Throw up a spinner.
Sunday, March 11, 12
Touch interfaces are
           tactile.




Sunday, March 11, 12
Touch interfaces are
           tactile.


                       Feedback must be
                            continuous.
Sunday, March 11, 12
When the interface
                         stops moving
                       during a gesture it
                        feels like it died

Sunday, March 11, 12
Respect Convention




Sunday, March 11, 12
Mobile has
                conventions
                too




Sunday, March 11, 12
Mobile has
                conventions
                too




Sunday, March 11, 12
TouchEvent

                       • touchstart - fires once
                       • touchmove - fires continuously
                       • touchend - fires once


Sunday, March 11, 12
The touches Array

                       • You only get one on Android
                       • You get up to 11 on iOS
                       • Each touch gives you position
                         information, and sometimes scale




Sunday, March 11, 12
iOS Gesture Events

                       • gesturestart
                       • gesturechange
                       • gestureend


Sunday, March 11, 12
iOS Developer
                          Library

             http://bit.ly/iOS-guide


Sunday, March 11, 12
Making Gestures Work

                       • Prioritize user feedback
                       • Use hardware acceleration
                       • Manage your memory


Sunday, March 11, 12
Prioritize User-feedback



                       • Don’t do any loading during gestures
                       • Treat the DOM as write-only (do your
                         own math)

                       • When at all possible, use css
                         transitions



Sunday, March 11, 12
Write-Only DOM

                       • DOM touches are really expensive
                       • You know where everything is
                       • Use matrix transforms to queue up
                         positions




Sunday, March 11, 12
Swipe Basics
 distance = e.touches[0].pageX - startX;

 'translate3d('+distance+'px,0px,0px)'




Sunday, March 11, 12
Snap back/snap
                             forward
                       • Keep track of last position, use
                         transitions with easing to snap back

                       • Pick a swipe distance threshold, use
                         that to snap forward (ontouchend)

                       • If the user is gesturing, the element
                         must be moving



Sunday, March 11, 12
A Word about scrolling

                       • Use native if at all possible:
                       • -webkit-overflow-scrolling:      touch;

                       • If not, use a library to simulate
                         momentum scroll (iScroll 4,
                         Scrollability)



Sunday, March 11, 12
Avoid Event
                       Abstraction


Sunday, March 11, 12
Image © Brian Lalor
  Used with permission




     Pinch to Zoom
     (there will be math)
Sunday, March 11, 12
Why you can’t use
                        native Pinch to
                             Zoom


Sunday, March 11, 12
First:
      Use Matrix Transforms
       Minimize DOM touches, make your transforms
       simpler in the long run




Sunday, March 11, 12
http://xkcd.com/184/

Sunday, March 11, 12
It’s Not That Hard!

    transform:          Translate
    matrix(1, 0, 0, 1, 10, 10);

                            Scale

Sunday, March 11, 12
With Hardware
       Acceleration... (matrix3d)


                       [
                           [1,0,0,0],
                           [0,1,0,0],
                           [0,0,1,0],
                           [tx,ty,tz,1]
                       ]


Sunday, March 11, 12
Transforms keep
                     complex state
                   without DOM reads


Sunday, March 11, 12
What is happening?

                       • Determine Center of the touch points
                       • Determine the scale factor
                         (touch.scale)

                       • Scale the element by the scale
                         factor, with the center of the touch
                         points as the scale center



Sunday, March 11, 12
The Naive Example




Sunday, March 11, 12
The Naive Example




Sunday, March 11, 12
The Naive Example




Sunday, March 11, 12
The Right Example




Sunday, March 11, 12
The Right Example




Sunday, March 11, 12
The Right Example




Sunday, March 11, 12
Breakdown




Sunday, March 11, 12
Breakdown




Sunday, March 11, 12
Breakdown




Sunday, March 11, 12
Breakdown




Sunday, March 11, 12
translateX =
       scalePointX * (newWidth - oldWidth)
                   newWidth;




Sunday, March 11, 12
Pro Tips

                       • Beware the virtual pixels
                       • Moving the transform-origin won’t
                         really work

                       • Remember to snap back

Sunday, March 11, 12
Dealing with
                        browsers




Sunday, March 11, 12
Dealing with
                        browsers




Sunday, March 11, 12
Remember
                       Progressive Enhancement?




Sunday, March 11, 12
Progressive Enhancement


              • Feature Detect
              • Add transitions, don’t depend on them
              • Gesture interaction is an enhancement,
                       clicks should still work

              • Be able to disable features per user-
                       agent, if necessary


Sunday, March 11, 12
The Tool Chain



Sunday, March 11, 12
The dumbest thing
                           that works

                                  Webkit
                                  Browser with
                                  UA Spoofing




Sunday, March 11, 12
Weinre

                                              Remote
                                              webkit
                                              debugger.



                       http://phonegap.github.com/weinre/

Sunday, March 11, 12
Internet Sharing +
                            Charles Proxy

                       • Watch HTTP traffic
                       • Add breakpoints in ajax requests
                       • Serve web pages to your phone from
                         your computer




Sunday, March 11, 12
Adobe Shadow

                       • Wrapper for Wienre
                       • Neat
                       • Has some limitations


Sunday, March 11, 12
Pile of Devices




Sunday, March 11, 12
Pile of Devices
                       • iPad 1       • Galaxy Tab
                       • iPhone 3G    • Motorola Xoom
                       • iPhone 4     • Kindle Fire
                       • Samsung      • HTC Titan
                        Galaxy S

                       • HTC Desire

Sunday, March 11, 12
Device Simulators &
                    Emulators:
                 Basically Useless.


Sunday, March 11, 12
The Flickr Touch
                          Light Box


Sunday, March 11, 12
Untitled
   By protohiro

Sunday, March 11, 12
Untitled
   By protohiro

Sunday, March 11, 12
Untitled
   By protohiro

Sunday, March 11, 12
Untitled
                       By protohiro




Sunday, March 11, 12
Swiping Process

                       • Event Listener on top level for touch
                         events

                       • Only visible nodes move via
                         translate3d

                       • Rebuild next/previous happens when
                         movement stops.



Sunday, March 11, 12
Performance Tricks

                       • Aggressive Pruning
                       • Clean off css transforms/transitions
                       • Write-only DOM.
                       • Do as little as possible during swipes

Sunday, March 11, 12
Frustrating
                                Limitations
                       • Retina screen is huge, device
                         memory is small

                       • Hardware acceleration is a crash
                         festival

                       • Fighting automatic optimization
                       http://bit.ly/apple-image-size-restrictions
Sunday, March 11, 12
Stephen Woods
                                       @ysaw
                       http://www.slideshare.net/ysaw/creating-
                          responsive-html5-touch-interfaces

                                               http://www.flickr.com/photos/wafer/5533140316/
                                               http://www.flickr.com/photos/latca/2265637876/
                                               http://www.flickr.com/photos/spine/1471217194/
                                               http://www.flickr.com/photos/williamhook/3656233025/
                                               http://www.flickr.com/photos/isriya/4656385586/
      Image Credits (http://flic.kr/y/kQ5cLh)   http://www.flickr.com/photos/yandle/3076451873/
                                               http://www.flickr.com/photos/uberculture/6632437677/
                                               http://www.flickr.com/photos/blalor/4934146981/
                                               http://www.flickr.com/photos/torek/3280152297/
                                               http://www.flickr.com/photos/nilsrinaldi/5157809941/	 	



Sunday, March 11, 12

More Related Content

Similar to Creating Responsive HTML5 Touch Interfaces

Resilient Response In Complex Systems
Resilient Response In Complex SystemsResilient Response In Complex Systems
Resilient Response In Complex SystemsJohn Allspaw
 
iOS Prototyping with Xcode Storyboards
iOS Prototyping with Xcode StoryboardsiOS Prototyping with Xcode Storyboards
iOS Prototyping with Xcode StoryboardsKyle Oba
 
iPad Apps for teachers
iPad Apps for teachersiPad Apps for teachers
iPad Apps for teachersRod Martin
 
OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012Theo Schlossnagle
 
Lightning talks percona live mysql_2012
Lightning talks percona live mysql_2012Lightning talks percona live mysql_2012
Lightning talks percona live mysql_2012Giuseppe Maxia
 
soft-shake.ch - Data grids and Data Grids
soft-shake.ch - Data grids and Data Gridssoft-shake.ch - Data grids and Data Grids
soft-shake.ch - Data grids and Data Gridssoft-shake.ch
 
MongoDB Hadoop and Humongous Data
MongoDB Hadoop and Humongous DataMongoDB Hadoop and Humongous Data
MongoDB Hadoop and Humongous DataMongoDB
 
Torchbox University Accessibility
Torchbox University AccessibilityTorchbox University Accessibility
Torchbox University Accessibilitymynameismartin
 
JS Tooling in Rails 3.1
JS Tooling in Rails 3.1JS Tooling in Rails 3.1
JS Tooling in Rails 3.1Duda Dornelles
 
Interfaces Inteligentes para Android
Interfaces Inteligentes para AndroidInterfaces Inteligentes para Android
Interfaces Inteligentes para AndroidNelson Glauber Leal
 
Why not to use Rails? (actually it's when not to use Rails)
Why not to use Rails? (actually it's when not to use Rails)Why not to use Rails? (actually it's when not to use Rails)
Why not to use Rails? (actually it's when not to use Rails)Arik Fraimovich
 
A Tour Through the Groovy Ecosystem
A Tour Through the Groovy EcosystemA Tour Through the Groovy Ecosystem
A Tour Through the Groovy EcosystemLeonard Axelsson
 
Layer 7 denial of services attack mitigation
Layer 7 denial of services attack mitigationLayer 7 denial of services attack mitigation
Layer 7 denial of services attack mitigationAmmar WK
 
Oliver Weidlich presentation
Oliver Weidlich presentationOliver Weidlich presentation
Oliver Weidlich presentationMetro Screen
 
Windows 1-8 voor het bedrijfsleven. Wat moet je ermee
Windows 1-8 voor het bedrijfsleven. Wat moet je ermeeWindows 1-8 voor het bedrijfsleven. Wat moet je ermee
Windows 1-8 voor het bedrijfsleven. Wat moet je ermeeVincent Everts
 
Building Multilingual Sites with Drupal 7
Building Multilingual Sites with Drupal 7Building Multilingual Sites with Drupal 7
Building Multilingual Sites with Drupal 7Acquia
 
Design process
Design processDesign process
Design processTim Wright
 
Fast Mobile UIs
Fast Mobile UIsFast Mobile UIs
Fast Mobile UIsWooga
 

Similar to Creating Responsive HTML5 Touch Interfaces (20)

Resilient Response In Complex Systems
Resilient Response In Complex SystemsResilient Response In Complex Systems
Resilient Response In Complex Systems
 
Mobile? WT... F?
Mobile? WT... F?Mobile? WT... F?
Mobile? WT... F?
 
iOS Prototyping with Xcode Storyboards
iOS Prototyping with Xcode StoryboardsiOS Prototyping with Xcode Storyboards
iOS Prototyping with Xcode Storyboards
 
iPad Apps for teachers
iPad Apps for teachersiPad Apps for teachers
iPad Apps for teachers
 
OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012OmniOS Motivation and Design ~ LISA 2012
OmniOS Motivation and Design ~ LISA 2012
 
Lightning talks percona live mysql_2012
Lightning talks percona live mysql_2012Lightning talks percona live mysql_2012
Lightning talks percona live mysql_2012
 
soft-shake.ch - Data grids and Data Grids
soft-shake.ch - Data grids and Data Gridssoft-shake.ch - Data grids and Data Grids
soft-shake.ch - Data grids and Data Grids
 
MongoDB Hadoop and Humongous Data
MongoDB Hadoop and Humongous DataMongoDB Hadoop and Humongous Data
MongoDB Hadoop and Humongous Data
 
Torchbox University Accessibility
Torchbox University AccessibilityTorchbox University Accessibility
Torchbox University Accessibility
 
JS Tooling in Rails 3.1
JS Tooling in Rails 3.1JS Tooling in Rails 3.1
JS Tooling in Rails 3.1
 
Interfaces Inteligentes para Android
Interfaces Inteligentes para AndroidInterfaces Inteligentes para Android
Interfaces Inteligentes para Android
 
Why not to use Rails? (actually it's when not to use Rails)
Why not to use Rails? (actually it's when not to use Rails)Why not to use Rails? (actually it's when not to use Rails)
Why not to use Rails? (actually it's when not to use Rails)
 
A Tour Through the Groovy Ecosystem
A Tour Through the Groovy EcosystemA Tour Through the Groovy Ecosystem
A Tour Through the Groovy Ecosystem
 
Layer 7 denial of services attack mitigation
Layer 7 denial of services attack mitigationLayer 7 denial of services attack mitigation
Layer 7 denial of services attack mitigation
 
Oliver Weidlich presentation
Oliver Weidlich presentationOliver Weidlich presentation
Oliver Weidlich presentation
 
Windows 1-8 voor het bedrijfsleven. Wat moet je ermee
Windows 1-8 voor het bedrijfsleven. Wat moet je ermeeWindows 1-8 voor het bedrijfsleven. Wat moet je ermee
Windows 1-8 voor het bedrijfsleven. Wat moet je ermee
 
Mobileweb
MobilewebMobileweb
Mobileweb
 
Building Multilingual Sites with Drupal 7
Building Multilingual Sites with Drupal 7Building Multilingual Sites with Drupal 7
Building Multilingual Sites with Drupal 7
 
Design process
Design processDesign process
Design process
 
Fast Mobile UIs
Fast Mobile UIsFast Mobile UIs
Fast Mobile UIs
 

Recently uploaded

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 

Recently uploaded (20)

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 

Creating Responsive HTML5 Touch Interfaces

  • 1. Creating Responsive HTML5 Touch Interfaces Stephen Woods Sunday, March 11, 12
  • 2. Stephen Woods Front End Engineer Flickr Sunday, March 11, 12
  • 4. On the desktop we worry about browsers -moz-transform:rotate(-270deg); -moz-transform-origin: bottom left; -webkit-transform: rotate(-270deg); -webkit-transform-origin: bottom left; -o-transform: rotate(-270deg); -o-transform-origin: bottom left; filter:progid:DXImageTransform.Microsoft .BasicImage(rotation=1); Sunday, March 11, 12
  • 5. On mobile we worry about devices. Sunday, March 11, 12
  • 6. Wait! Did you say they all run webkit? Sunday, March 11, 12
  • 7. Wait! Did you say they all run webkit? Sunday, March 11, 12
  • 8. Wait! Did you say they all run webkit? Sunday, March 11, 12 X
  • 9. On mobile we worry about devices. Sunday, March 11, 12
  • 10. Screen Sizes Media Queries, Break points, liquid layouts http://www.alistapart.com/articles/responsive-web-design/ Sunday, March 11, 12
  • 12. iPhone 3GS 256mb RAM Geekbench: 271 Sunday, March 11, 12
  • 13. iPhone 3GS 256mb RAM Geekbench: 271 == Sunday, March 11, 12
  • 14. Modern mobile devices are crappy computers with decent video cards. Sunday, March 11, 12
  • 16. Perceived Performance Sunday, March 11, 12
  • 17. On the desktop it’s easy... Throw up a spinner. Sunday, March 11, 12
  • 18. Touch interfaces are tactile. Sunday, March 11, 12
  • 19. Touch interfaces are tactile. Feedback must be continuous. Sunday, March 11, 12
  • 20. When the interface stops moving during a gesture it feels like it died Sunday, March 11, 12
  • 22. Mobile has conventions too Sunday, March 11, 12
  • 23. Mobile has conventions too Sunday, March 11, 12
  • 24. TouchEvent • touchstart - fires once • touchmove - fires continuously • touchend - fires once Sunday, March 11, 12
  • 25. The touches Array • You only get one on Android • You get up to 11 on iOS • Each touch gives you position information, and sometimes scale Sunday, March 11, 12
  • 26. iOS Gesture Events • gesturestart • gesturechange • gestureend Sunday, March 11, 12
  • 27. iOS Developer Library http://bit.ly/iOS-guide Sunday, March 11, 12
  • 28. Making Gestures Work • Prioritize user feedback • Use hardware acceleration • Manage your memory Sunday, March 11, 12
  • 29. Prioritize User-feedback • Don’t do any loading during gestures • Treat the DOM as write-only (do your own math) • When at all possible, use css transitions Sunday, March 11, 12
  • 30. Write-Only DOM • DOM touches are really expensive • You know where everything is • Use matrix transforms to queue up positions Sunday, March 11, 12
  • 31. Swipe Basics distance = e.touches[0].pageX - startX; 'translate3d('+distance+'px,0px,0px)' Sunday, March 11, 12
  • 32. Snap back/snap forward • Keep track of last position, use transitions with easing to snap back • Pick a swipe distance threshold, use that to snap forward (ontouchend) • If the user is gesturing, the element must be moving Sunday, March 11, 12
  • 33. A Word about scrolling • Use native if at all possible: • -webkit-overflow-scrolling: touch; • If not, use a library to simulate momentum scroll (iScroll 4, Scrollability) Sunday, March 11, 12
  • 34. Avoid Event Abstraction Sunday, March 11, 12
  • 35. Image © Brian Lalor Used with permission Pinch to Zoom (there will be math) Sunday, March 11, 12
  • 36. Why you can’t use native Pinch to Zoom Sunday, March 11, 12
  • 37. First: Use Matrix Transforms Minimize DOM touches, make your transforms simpler in the long run Sunday, March 11, 12
  • 39. It’s Not That Hard! transform: Translate matrix(1, 0, 0, 1, 10, 10); Scale Sunday, March 11, 12
  • 40. With Hardware Acceleration... (matrix3d) [ [1,0,0,0], [0,1,0,0], [0,0,1,0], [tx,ty,tz,1] ] Sunday, March 11, 12
  • 41. Transforms keep complex state without DOM reads Sunday, March 11, 12
  • 42. What is happening? • Determine Center of the touch points • Determine the scale factor (touch.scale) • Scale the element by the scale factor, with the center of the touch points as the scale center Sunday, March 11, 12
  • 53. translateX = scalePointX * (newWidth - oldWidth) newWidth; Sunday, March 11, 12
  • 54. Pro Tips • Beware the virtual pixels • Moving the transform-origin won’t really work • Remember to snap back Sunday, March 11, 12
  • 55. Dealing with browsers Sunday, March 11, 12
  • 56. Dealing with browsers Sunday, March 11, 12
  • 57. Remember Progressive Enhancement? Sunday, March 11, 12
  • 58. Progressive Enhancement • Feature Detect • Add transitions, don’t depend on them • Gesture interaction is an enhancement, clicks should still work • Be able to disable features per user- agent, if necessary Sunday, March 11, 12
  • 59. The Tool Chain Sunday, March 11, 12
  • 60. The dumbest thing that works Webkit Browser with UA Spoofing Sunday, March 11, 12
  • 61. Weinre Remote webkit debugger. http://phonegap.github.com/weinre/ Sunday, March 11, 12
  • 62. Internet Sharing + Charles Proxy • Watch HTTP traffic • Add breakpoints in ajax requests • Serve web pages to your phone from your computer Sunday, March 11, 12
  • 63. Adobe Shadow • Wrapper for Wienre • Neat • Has some limitations Sunday, March 11, 12
  • 64. Pile of Devices Sunday, March 11, 12
  • 65. Pile of Devices • iPad 1 • Galaxy Tab • iPhone 3G • Motorola Xoom • iPhone 4 • Kindle Fire • Samsung • HTC Titan Galaxy S • HTC Desire Sunday, March 11, 12
  • 66. Device Simulators & Emulators: Basically Useless. Sunday, March 11, 12
  • 67. The Flickr Touch Light Box Sunday, March 11, 12
  • 68. Untitled By protohiro Sunday, March 11, 12
  • 69. Untitled By protohiro Sunday, March 11, 12
  • 70. Untitled By protohiro Sunday, March 11, 12
  • 71. Untitled By protohiro Sunday, March 11, 12
  • 72. Swiping Process • Event Listener on top level for touch events • Only visible nodes move via translate3d • Rebuild next/previous happens when movement stops. Sunday, March 11, 12
  • 73. Performance Tricks • Aggressive Pruning • Clean off css transforms/transitions • Write-only DOM. • Do as little as possible during swipes Sunday, March 11, 12
  • 74. Frustrating Limitations • Retina screen is huge, device memory is small • Hardware acceleration is a crash festival • Fighting automatic optimization http://bit.ly/apple-image-size-restrictions Sunday, March 11, 12
  • 75. Stephen Woods @ysaw http://www.slideshare.net/ysaw/creating- responsive-html5-touch-interfaces http://www.flickr.com/photos/wafer/5533140316/ http://www.flickr.com/photos/latca/2265637876/ http://www.flickr.com/photos/spine/1471217194/ http://www.flickr.com/photos/williamhook/3656233025/ http://www.flickr.com/photos/isriya/4656385586/ Image Credits (http://flic.kr/y/kQ5cLh) http://www.flickr.com/photos/yandle/3076451873/ http://www.flickr.com/photos/uberculture/6632437677/ http://www.flickr.com/photos/blalor/4934146981/ http://www.flickr.com/photos/torek/3280152297/ http://www.flickr.com/photos/nilsrinaldi/5157809941/ Sunday, March 11, 12