Holt was crap for a long time. That is why many people went elsewhere. HS is decent though.
I don't think we will ever see big expensive anchors in downtown Edmonton - our demographics just don't support those types of businesses. High income population in DT Edmonton is tiny. High end condos beyond some nice penthouses and the JW are non-existent. We can support a few smaller players like HS and the Helm.
As for feeling safe, there is low income people in every city on earth, especially downtown areas. Sure, we can work to mitigate and reduce that footprint, but it isn't going to go away. People in small towns will always flock to urban centers, because social supports exist in cities. I don't feel any less safe in Edmonton than I have in other cities I have lived in. Downturns in the economy will also always increase people living on the street and substance abuse. That is not something that downtown Edmonton can solve on its own.
Holt, Harry Rosen, Brooks Brothers, and now Simons are pretty big anchors for CORE. Sure, Chinook has pulled some business, but not all.