Kazim-Richards, 26, netted a scrappy effort on 72 minutes at the Emirates Stadium on Saturday, which was about npower Championship Rovers only shot on target but enough to inflict a first FA Cup defeat by lower league opposition on beleaguered Arsenal manager Arsene Wenger.
The on-loan Galatasaray forward was on Arsenal's books as a youngster, and said: "I was here as a schoolboy, so my connections are to Arsenal, I am an Arsenal fan. I love Arsenal."
He added: "I will be supporting them on Tuesday against Bayern Munich. I will have my Arsenal top on, and I will be there in front of the TV, but you know this is work.
"This is what I get paid to do and it's nice for the Blackburn fans, to give back because they have had a rough time, everybody knows what's gone on so it is nice for them to be able to celebrate."
Kazim-Richards admits it was a surreal experience to take on his boyhood club.
"I used to train under the Clock End (at Highbury) on the indoor pitches, so for me to get the goal is amazing. You dream of stuff like this and for it to come true," said Kazim-Richards, who dedicated the goal to his brother Rodney who passed away as an infant from Edwards Syndrome.
"My dad was in the crowd, he comes to every game so for him to see it was great. My mum was there too, so for them it was a nice day."
Rovers have been handed a quarter-final tie away at Millwall.