Here are 2 definitions of the word cult. Wouldn't you say one of these applies. Perhaps your religion is a cult under these definitions ?
2: a system of religious beliefs and ritual ; also : its body of adherents
3: a religion regarded as unorthodox or spurious ; also : its body of adherents