I once led a two-year-long battle against clothes moths.
Eventually I've discovered the infestation source as an old wool blanket. Those were some stressful two years.
Don't let them create a spawn point, or you'll have your wool/silk clothes all full of holes.