Father accused of shaking infant will stay in jail