You don't need a huge following to build authority. Just focus your efforts on a narrowly-defined group of people - those with problems you can solve.