I was dealing with the same problem. With only the Main board installed I was getting a lot of noise out of the speaker and on the spectrum display. Re-seating the PCM1808 and the PCM5102 didn't help so yesterday I changed them both ... total silence.
Tom - AJ8X