Game controller issues …

Control issues persisting with 3d rudder & leap motion for fine motorskills in gaming.

Primary issue is learning the controls.

Learning controls as well as instinctive keyboard mashing with no fine controls.

Example … when playing a tense game & surprised you naturally seize up slightly as you beginning frantically tapping the required keys – that reaction will in a system like 3d rudder will just send your character/vehicle spinning in place, breaking immersion & killing any fun as you die without control of the game.

Learning seems to be impeded without (traditionally) physical feedback or resistance to allow the user to feel via the legs (3drudder) or in the hands for the leapmotion.  Both controllers are currently in the gimmick stage unless a user commits serious time to unlearning their normal keyboard controls and learning new reflexive motions.

To explain this more fully …

Several scenarios exist for movement.  Each requiring their own set of motions to satisfy the in game movement controls.

  • Micro adjustments
    • At rest doing fine controls
      • turning
      • advancing incrementally – like inching forward or back
  • Dealing with rate of change increase or decrease
    • mid range speeds if the game as them
      • toggle speed modes walk/run/scope up
      • throttle style speeds based on percent of pushing control

Solutions to the training issue?

On the physical side, we

Leap motion or other body scanning-style or non-physical controllers

  • I’ve taken to using a large hard surface mouse pad/plate to hold the leap motion controller, with taped down lines of where the sensitivity boundaries are
    • this requires a player to look down at the desk occasionally
    • the leapmotion plate be within peripheral vision with the arm be farther forward & strains nature body posture, can’t do it long without being
    • both options break game immersion experience
  • Visual
    • Overlays of the game
      • Gamewave provides out of bounds feedback in it’s app
      • perhaps copying this into an existing gaming program with an overlay
        • mumble uses overwolf, ts3
        • windows 8 & 10 have built in overlay in windowed mode for xbox – must have a UI hook I could build for
    • if not done right this could break immersion too
    • 2nd screen on computer running visual feedback
  • Vibrating haptic feed back on the hand / wrist / arm
    • any smart watch with blue tooth can sync an app
      • sense boundaries setup by devices on desk
        • nfc?
        • lower level protocol?
  • Sound feedback
    • low grade tones
    • voice assistant
      • Halo type voice
      • i18n implementation to setup voice mapping
      • voiceattack style bindings
    • Directly interferes with game sound, hard break in immersion

3D Rudder

  • Physical feedback
    • A foam pad to add resistance?
      • Maybe two levels of resistance
  • gyros already exist
    • figure out an overlay option like in the visual section of the Leap Motion

Testing ideas

Doing more Ruby on Rails today.

For ensuring data is good …

Anyone ever try using a scope to drop bad results and streamline view presentation?

Then just show the malformed entries on a different view where it doesn’t bork everything up?

Example I hit …

- if pet.user_detail 
- else 
  %td= "Crap"

Revealed I had a single bad piece of data in my test results.

I’ve been playing around with rescue strategies etc for a year when something is missing.

Something like this guy does, though I used another’s idea last year … Link

Having struggled with this several times, I am considering the viability of a scope or series of them that presents only data that is valid & present.  Something tells me there is probably a better way in code to do this, but the “If you absolutely & completely must be sure nothing should get to the view unless the record is good…” part of me is going “HRRRRMM”.

From time as a database admin, I would solve this issue in the DB, as a well formed one would have checks against bad data, but from a coders perspective there are more tools available and the database won’t always know what constitutes good data.

Interview Questions

What is the process?

Fill in any gaps in this with …

  • How many applications received versus selected?
  • How many people will get interviews?
  • What’s entailed in hiring process?
  • Length of hiring window?
  • 2 week notice allowed?
  • Follow up email of denial?
  • What was the past year of hiring like?
  • What team would I be on?
    • Size?
    • How many in Management / Leads / Senior positions?
    • Who is direct boss & their boss?
  • Hours / Remote – Work from home?
  • What sort of training / pairing exploration of company best practices or resources on accepted ‘house rules’ is available?
  • What created the opening?  New position or vacancy or promotion?
  • Before I take any tests – what’s the pay range?  Not what are you paying me, but what range do you have a budget for?  This becomes important as some companies are asking for week long applications to be built as part of their interview process.
  • May I contact you?

Wearable’s with haptics

Some examples of people doing stuff

  • bass wrist band – Link
  • gloves that act as sonar for blind – Link
  • wrist band to hug via cell phone – Link
  • rassbery pi’s (older) – Link
  • triple haptic in wrist watch shape from a college project – Link
  • Bass backpack (sub pac m2) – Link
  • The hug shirt – 2002 wearable, washable shirt – Link
  • Yoga trainer pants – pose correction – Link

Some research

Haptic motors etc

  • text instruments has some chips with bluetooth built in – Link

Power issues


  • Rassbery PI w – bluetooth/wifi built in at $10 – Link
  • Flora is a sewable? – $17 –  Link

SSH to your PI – Link

Art Tablets

Mixed / AR human interface

Lots of toys out lately that are interesting!

Room scanning

  • leap motion finger/hand/wrist sensors
  • eye tracking readers for mice
  • kinect is on fire sale @ ~ $130

Wear able screens

  • oculus
  • atheer glasses – another simplified setup for task based MR – link
  • vuzix m3000 – glasses mounted competitor to the google glass corp ed
  • hololens
  • zapbox – the google cardboard of MR
  • htc vive
  • epson moverio – MR can be used over a feed for drones!
  • sony’s vr w/ps4
  • recon jet for sports – Link
  • google class enterprise
  • ODG – table top cube…can’t reach in it, but can project on/off it
  • accer’s cheap microsoft hololens
  • smart eye glasses
  • meta2 – hololens competitor w/higher res selection & hand sensors built in visor

Control tools

  • 3d rudder – 4 axis controller with excellent game library suppor
  • Laser projected mouse controller for $70 – Link
  •  LeapMotion programming kit for $80 – Link
  • Neonode TouchBar – Touchscreen Capabilities for $70 – Link
  • Tobii eyeX – eye tracking for a mouse for  $70 – Link
  • Echo dot – Link
  • VoiceAttack – software using mic
  • Microsofts voice
  • kinect