In recent years, Finnish cities have seen an influx of itinerant Roma, mainly from Romania and Bulgaria, many of who beg on the streets.
Finns' Party MP Jussi Halla-aho issued a demand that the government take action to sweep the phenomenon of begging from Finland's streets.
"The activity includes features of human trafficking and organized crime," Halla-aho stated.
Stubb shot back, saying that he hoped that the debate on the issue would not be carried out in the tone used by Halla-aho.
"We are on the verge of an attempt to label an entire people," said Stubb, who represents the National Coalition Party.
Christian Democratic Interior Minister Päivi Räsänen pledged an examination of whether or not organizing begging should be made a criminal offense.