Bill Whitfield said Jackson was ‘sad a lot’ and liked to take long drives