Second-half strikes from Jay Emmanuel-Thomas and Scott Wagstaff sealed a 2-1 victory for the home side, with Owen Garvan grabbing a consolation for Palace in stoppage time.
Defeat was a blow for Holloway, but perhaps not entirely surprising - he made 11 changes from Saturday's 2-1 defeat at Stoke.
Sunderland boss Paolo Di Canio avoided a similar upset as the Black Cats hit back from 2-0 down to beat Milton Keynes Dons 4-2 at the Stadium of Light.
Goals from Patrick Bamford and Izale McLeod put the visitors in control before Jozy Altidore finally got the home side on the scoresheet with 12 minutes left.
The home side's dramatic revival soon kicked into gear with Connor Wickham equalising three minutes from time and netting Sunderland's third in the 89th minute. Adam Johnson completed the comeback deep into injury time.
Ravel Morrison marked his full West Ham debut with his first goal as the Hammers edged past League Two strugglers Cheltenham at Upton Park.
Ricardo Vaz Te's direct free-kick gave Sam Allardyce's men the lead three minutes before half-time and then Morrison struck moments into the second half after a precise cross from Stewart Downing.
Cheltenham fought their way back through a Matt Richards penalty in the 58th minute, but the Hammers held on for a 2-1 win.
Sweden international Johan Elmander marked his full Norwich bow with a brace in the Premier League side's 6-3 win over Bury.
Elmander set up Martin Olsson for a 23rd-minute opener and Anthony Pilkington made it 2-0 on the half-hour before Elmander got on the scoresheet himself seven minutes into the second half.
Bury pulled one back through Anton Forrester before Elmander hit his second and, after a second Bury goal through William Edjenguele, another Canaries new boy, Leroy Fer, made it 4-2 to the hosts.
The scoring continued into injury time with Norwich substitute Steven Whittaker grabbing a sixth for the hosts before Jessy Reindorf hit another consolation for the visitors.
Goals from Steven Davis and Jay Rodriguez sent Southampton on their way to a 5-1 romp at Championship bottom club Barnsley.
Stephen Dawson pulled a goal back before further strikes from Emmanuel Mayuka, a Davis penalty and an injury-time effort from Gaston Ramirez.