For the younger Pliny, when he was ruler of a province, having condemned some Christians to death, and driven some from their steadfastness, being still annoyed by their great numbers, at last sought the advice of Trajan, the reigning emperor, as to what he was to do with the rest, explaining to his master that, except an obstinate disinclination to offer sacrifices, he found in the religious services nothing but meetings at early morning for singing hymns to Christ and God, and sealing home their way of life by a united pledge to be faithful to their religion, forbidding murder, adultery, dishonesty, and other crimes. Upon this Trajan wrote back that Christians were by no means to be sought after; but if they were brought before him, they should be punished.
Tertullian
Apology
Chapter I