The actor’s foundation built 109 houses but many were allegedly not fit for purpose