Some observers have suggested that domestic investors in Toronto are partially responsible for driving up prices in the hot housing market, making it difficult for prospective home buyers.