Can't cancel phone service

We do not use our phone anymore and I call to have it removed and I'm told it would be cheaper to keep it!?? How is it cheaper? It will lower my bill by almost $30. So why pay that if I don't use it? Plus the installer took our phone modem, so I can't use it!