The definition of a heretic

…a heretic may from his case be designated as one who, forsaking that which was prior, afterwards chose out for himself that which was not in times past. For in as far as what was delivered in times past and from the beginning will be held as truth, in so far will that be accounted heresy which is brought in later.

Tertullian
Five Books Against Marcion, Book I
Chapter I

Heretics don’t follow the same practices and can be refuted therefore without the scriptures

These evidences, then, of a stricter discipline existing among us, are an additional proof of truth, from which no man can safely turn aside, who bears in mind that future judgment, when “we must all stand before the judgment-seat of Christ,” to render an account of our faith itself before all things.

On the present occasion, indeed, our treatise has rather taken up a general position against heresies, (showing that they must) all be refuted on definite, equitable, and necessary rules, without any comparison with the Scriptures.

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XLIV

Heretics lack discipline because they do not fear God

They say that God is not to be feared; therefore all things are in their view free and unchecked. Where, however is God not feared, except where He is not? Where God is not, there truth also is not. Where there is no truth, then, naturally enough, there is also such a discipline as theirs. But where God is, there exists “the fear of God, which is the beginning of wisdom.” Where the fear of God is, there is seriousness, an honourable and yet thoughtful diligence, as well as an anxious carefulness and a well-considered admission (to the sacred ministry)2296 and a safely-guarded communion, and promotion after good service, and a scrupulous submission (to authority), and a devout attendance, and a modest gait, and a united church, and God in all things.

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XLIII

Heretics continue to schism and can’t agree among themselves

Hence it is [supposed] that schisms seldom happen among heretics, because, even when they exist, they are not obvious. Their very unity, however, is schism. I am greatly in error if they do not amongst themselves swerve even from their own regulations, forasmuch as every man, just as it suits his own temper, modifies the traditions he has received after the same fashion as the man who handed them down did, when he moulded them according to his own will.  The progress of the matter is an acknowledgment at once of its character and of the manner of its birth. That was allowable to the Valentinians which had been allowed to Valentinus; that was also fair for the Marcionites which had been done by Marcion—even to innovate on the faith, as was agreeable to their own pleasure. In short, all heresies, when thoroughly looked into, are detected harboring dissent in many particulars even from their own founders. The majority of them have not even churches. Motherless, houseless, creedless, outcasts, they wander about in their own essential worthlessness.

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XLII

The heretics either add gods in addition, or change the one God into something else

They either pretend that there is another god in opposition to the Creator, or, even if they acknowledge that the Creator is the one only God, they treat of Him as a different being from what He is in truth. The consequence is, that every lie which they speak of God is in a certain sense a sort of idolatry.

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XL

Diversity of doctrine among the heretics is the mark of heresy

Where diversity of doctrine is found, there, then, must the corruption both of the Scriptures and the expositions thereof be regarded as existing. On those whose purpose it was to teach differently, lay the necessity of differently arranging the instruments of doctrine. They could not possibly have effected their diversity of teaching in any other way than by having a difference in the means whereby they taught. As in their case, corruption in doctrine could not possibly have succeeded without a corruption also of its instruments, so to ourselves also integrity of doctrine could not have accrued, without integrity in those means by which doctrine is managed. Now, what is there in our Scriptures which is contrary to us? What of our own have we introduced, that we should have to take it away again, or else add to it, or alter it, in order to restore to its natural soundness anything which is contrary to it, and contained in the Scriptures? What we are ourselves, that also the Scriptures are (and have been) from the beginning. Of them we have our being, before there was any other way, before they were interpolated by you.

…. One man perverts the Scriptures with his hand, another their meaning by his exposition. For although Valentinus seems to use the entire volume, he has none the less laid violent hands on the truth only with a more cunning mind and skill than Marcion. Marcion expressly and openly used the knife, not the pen, since he made such an excision of the Scriptures as suited his own subject-matter. Valentinus, however, abstained from such excision, because he did not invent Scriptures to square with his own subject-matter, but adapted his matter to the Scriptures; and yet he took away more, and added more, by removing the proper meaning of every particular word, and adding fantastic arrangements of things which have no real existence.

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XXXVIII

The heretics are refuted by tradition, without a battle over scriptural interpretation

Since this is the case, in order that the truth may be adjudged to belong to us, “as many as walk according to the rule,” which the church has handed down from the apostles, the apostles from Christ, and Christ from God, the reason of our position is clear, when it determines that heretics ought not to be allowed to challenge an appeal to the Scriptures, since we, without the Scriptures, prove that they have nothing to do with the Scriptures. For as they are heretics, they cannot be true Christians, because it is not from Christ that they get that which they pursue of their own mere choice, and from the pursuit incur and admit the name of heretics. Thus, not being Christians, they have acquired no right to the Christian Scriptures; and it may be very fairly said to them, “Who are you? When and whence did you come? As you are none of mine, what have you to do with that which is mine?

Indeed, Marcion, by what right do you hew my wood?  By whose permission, Valentinus, are you diverting the streams of my fountain? By what power, Apelles, are you removing my landmarks? This is my property. Why are you, the rest, sowing and feeding here at your own pleasure?  This (I say) is my property. I have long possessed it; I possessed it before you. I hold sure title-deeds from the original owners themselves, to whom the estate belonged.  I am the heir of the apostles.  Just as they carefully prepared their will and testament, and committed it to a trust, and adjured (the trustees to be faithful to their charge), even so do I hold it. As for you, they have, it is certain, always held you as disinherited, and rejected you as strangers—as enemies. But on what ground are heretics strangers and enemies to the apostles, if it be not from the difference of their teaching, which each individual of his own mere will has either advanced or received in opposition to the apostles?”

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XXXVII

Martyrdom of the Apostles and the core of their teaching

Come now, you who would indulge a better curiosity, if you would apply it to the business of your salvation, run over the apostolic churches, in which the very thrones of the apostles are still pre-eminent in their places, in which their own authentic writings are read, uttering the voice and representing the face of each of them severally. Achaia is very near you, (in which) you find Corinth. Since you are not far from Macedonia, you have Philippi; (and there too) you have the Thessalonians. Since you are able to cross to Asia, you get Ephesus. Since, moreover, you are close upon Italy, you have Rome, from which there comes even into our own hands the very authority (of apostles themselves). How happy is its church, on which apostles poured forth all their doctrine along with their blood! where Peter endures a passion like his Lord’s! where Paul wins his crown in a death like John’s where the Apostle John was first plunged, unhurt, into boiling oil, and thence remitted to his island-exile! See what she has learned, what taught, what fellowship has had with even (our) churches in Africa! One Lord God does she acknowledge, the Creator of the universe, and Christ Jesus (born) of the Virgin Mary, the Son of God the Creator; and the Resurrection of the flesh; the law and the prophets she unites in one volume with the writings of evangelists and apostles, from which she drinks in her faith. This she seals with the water (of baptism), arrays with the Holy Ghost, feeds with the Eucharist, cheers with martyrdom, and against such a discipline thus (maintained) she admits no gainsayer.

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XXXVI

Heretics must prove that the orthodox lack continuity with the Apostolic faith

…since they deny the truth of (our doctrine), they ought to prove that it also is heresy, refutable by the same rule as that by which they are themselves refuted; and at the same time to show us where we must seek the truth, which it is by this time evident has no existence amongst them.  Our system is not behind any in date; on the contrary, it is earlier than all; and this fact will be the evidence of that truth which everywhere occupies the first place.

Tertullian
Against Marcion
The Prescription Against Heretics
Chapter XXXV