It's true that you won't get as many experience points. Furthermore, you might miss out on some information that would be helpful for successfully completing the case. For more information on getting the questions right, see these guides: http://www.sleeandtopher.com/gaming/guides/la-noire-case-guides/