I spoke with a second TS HA which we both agreed we wouldn't class this as Following, however, you did in fact follow at the start.
However I personally would put this under rule 3. Do not harass users.
You was also extremely lucky you did not get banned when you started playing racial music down the mic.
I believe the ban is justified.