A textile manufacturer fears for the future of the industry in Huddersfield after a lack of success in recruiting apprentices.