Hey,
You use your pinky for the 16th fret I'm understanding but then index for 12th fret E string and middle finger for 12th fret B string?
It doesn't make sense that your hand would move MORE when you use index & middle finger as opposed to just your index.
Do you have a video or something?