Online footage showed the legislator at a town square in Tuen Mun around 9am, with supporters also sweeping with brooms and dust-pans.
However an argument broke out when Ho later showed up in Shau Kei Wan. Online footage showed residents shouting insults at him and asking him to leave.
He and his supporters responded by chanting Hong Kong is their home and they’re cleaning it up. Police later arrived to separate the two sides after Ho had left by car.
Ho had previously said the day-long “Clean Hong Kong” campaign was aimed at Lennon Walls in all 18 districts – but announced on Friday night that his team should only clean up rubbish on the streets due to “safety concerns”.
His original plan had sparked fears of potential violence between pro- and anti-government supporters.
On Friday afternoon police appealed for calm, while anti-government protesters had vowed to defend themselves if they came under attack.
Police said there had been multiple attacks and assaults at Lennon Walls over the past three months.