Your Swipe script only looks at touch 0. Subsequent touches get ignored, not what you want.
Your Swipe script doesn't check to see if the touch is already handled by the joystick (ie. on the left side of the screen), so it can ignore it.
I'd rewrite the swipe script to look something more like this instead. Advantages of this approach: