Subject: Re: spurious mce Hardware Error messages in next-20250912

From: Bert Karwatzki <[email-masked]>
Date: Fri, 19 Sep 2025 00:07:15 +0200

Am Donnerstag, dem 18.09.2025 um 17:00 -0400 schrieb Yazen Ghannam:
> On Thu, Sep 18, 2025 at 01:20:58PM +0300, Nikolay Borisov wrote:
> > 
> > 
> > On 9/17/25 22:26, Yazen Ghannam wrote:
> > <snip>
> > 
> > 
> > > Right, so it seems we have bogus data logged in these registers. And
> > > this is unrelated to the recent patches.
> > > 
> > > We have some combination of bits set in MCA_DESTAT registers. The
> > > deferred error interrupt hasn't fired (at least from the latest
> > > example).
> > > 
> > > There does seem to be some combination of bits that are always set and
> > > others flip between examples.
> > > 
> > > I'll highlight this to our hardware folks. But I don't think there's
> > > much we can do other than filter these out somehow.
> > > 
> > > I can add two checks to the patch to make it more like the current
> > > behavior.
> > > 
> > > 1) Check for 'Deferred' status bit when logging from the MCA_DESTAT.
> > > This was in the debug patch I shared.
> > 
> > According to AMD APM 9.3.3.4:
> > 
> > "If the error being logged is a deferred error, then the error will be
> > logged to MCA_DESTAT."
> > 
> > So this means that when Valid is set in DESTAT then the error MUST BE
> > deferred. I.e I think it's in valid to have valid && !deferred in DESTAT, no
> > ?
> 
> Yes, correct. That is why this issue is perplexing.
> 
> > 
> > Additionally nowhere in the APM is ti mentioned what's the default value of
> > MCA_CONFIG.LogDeferredEn so as it stands you are now working with the
> > assumption that it's 1 and DESTAT is always a redundant copy of STATUS.
> > 
> 
> The value is determined by the platform. The Linux code is structured so
> the data is gathered from any possible source. That's why there are a
> few checks to determine which register to look at.
> 
> > Btw looking at the output that Bert has provided it seems that indeed
> > MCA_CONFIG.LogDeferredEn is 0 by default:
> 
> Banks 9 to 14 seem to have bogus values. And this seems to be the cause
> of our mishandling here.
> 
> You can see the difference compared to the other banks. Banks 7 and 8
> are good comparisons as they are of the same "type" (L3 cache).
> 
> > 
> > "
> > LogDeferredEn—Bit 34. Enable logging of deferred errors in MCA_STATUS. 0=Log
> > deferred errors only in MCA_DESTAT and MCA_DEADDR. 1=Log deferred errors in
> > MCA_STATUS and MCA_ADDR in addition to MCA_DESTAT and MCA_DEADDR. This bit
> > does not affect logging of deferred errors in MCA_SYND or MCA_MISCx.
> > "
> > 
> > 
> > I think the polling code is slightly broken now for AMD. The order of
> > operation per poll cycle should be:
> > 
> > 1. Check MCA_STATUS -> report if there is anything, clear it the bank
> > 2. (In the same cycle) -> Check DEFERRED and report if there is anything,
> > clear the deferred.
> > 
> 
> It is unlikely to have two independent errors in MCA_STATUS and
> MCA_DESTAT due to how errors can be overwritten by more severe errors.
> By default, our reference platform implementation has
> MCA_CONFIG[LogDeferredInMcaStat] enabled. So a deferred error in
> MCA_STATUS will only be overwritten by an uncorrectable (#MC) error. In
> this case, MCA_STATUS will be cleared by the #MC handler. And so
> MCA_DESTAT acts as a backup.
> 
> But you're right there is a gap here that we can try to fill if a
> platform ever changes this config bit.
> 
> 
> 
> For the current issue, it does seem that the registers contain junk
> values. And we are only now seeing this with the recent rework.
> 
> Bert, can you please provide two more register dumps from the script?
> 
> Our hardware team is interested to see if the values remain consistent
> or change between reads.
> 
> Thanks,
> Yazen

Dump from linux next-20250912 (with the debugging patch) right after boot:

# bash rdmsr.sh
Bank 0
CTL:	0x0000000000ffffff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000027000001fd
IPID:	0x001000b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 1
CTL:	0x000000000007ffff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000100b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 2
CTL:	0x000000000000000f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000025000001ff
IPID:	0x000200b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 3
CTL:	0x00000000000003ff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000300b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 4
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 5
CTL:	0x0000000000003fff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000500b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 6
CTL:	0x000000000000007f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000600b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 7
CTL:	0x00000000000000ff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000025000001ff
IPID:	0x000700b020350000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 8
CTL:	0x00000000000000ff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000025000001ff
IPID:	0x000700b020350100
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 9
CTL:	0x000000000000000c
STATUS:	0x054358400005d2b0
ADDR:	0x0000000000000000
MISC0:	0x0010000900000000
CONFIG:	0x00000000000001ff
IPID:	0x000750b00005d2b0
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0050000018a0000c
DEADDR:	0x054358400005d2b0
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 10
CTL:	0x0000000000000000
STATUS:	0x0050000018a0000c
ADDR:	0x054358400005d2b0
MISC0:	0x0010000000000000
CONFIG:	0x00000029000001ff
IPID:	0x000700b018a0000c
SYND:	0x000158400005d2b0
RESV:	0x0000000000000000
DESTAT:	0x0001803100070600
DEADDR:	0x0050000018a0000c
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 11
CTL:	0x0000000000000000
STATUS:	0x0000000300070600
ADDR:	0x4f83058100208912
MISC0:	0x0010004800000000
CONFIG:	0x00000000000001ff
IPID:	0x000700b040000000
SYND:	0x0000000000000042
RESV:	0x0000000000000000
DESTAT:	0x8424aa4800a9413b
DEADDR:	0x004bc0e000000020
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 12
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x00000000000001ff
IPID:	0x000700b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0a50000c00000000
DEADDR:	0x0020891200000003
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 13
CTL:	0x0000000000000048
STATUS:	0x0000000000300000
ADDR:	0x00000000001ace4b
MISC0:	0x00100c5d00000000
CONFIG:	0x0000001500000006
IPID:	0x000700b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 14
CTL:	0x00000000000000ff
STATUS:	0x000000030a50000c
ADDR:	0x4f83058100208912
MISC0:	0x0010004800000000
CONFIG:	0x00000000000001ff
IPID:	0x000700b040000000
SYND:	0x0000000000000042
RESV:	0x0000000000000000
DESTAT:	0x8724aa0800000000
DEADDR:	0x00125cd400000020
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 15
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 16
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 17
CTL:	0x000000000000003f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000001000000
CONFIG:	0x000000270000007d
IPID:	0x0000009600050f00
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0xd01a000001000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 18
CTL:	0x000000000000003f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000001000000
CONFIG:	0x000000270000007d
IPID:	0x0000009600150f00
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0xd01a000001000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 19
CTL:	0x0000000000003fff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x000000250000007f
IPID:	0x0002002e00000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 20
CTL:	0x0000000000003fff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x000000250000007f
IPID:	0x0002002e00000001
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 21
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 22
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 23
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 24
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 25
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 26
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 27
CTL:	0x000000000000001f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x000000270000007d
IPID:	0x0001002e0000000b
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 28
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 29
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 30
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 31
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

This is the dump after the first debug message
[  333.337523] [      C0] mce: DEBUG: CPU0 Bank:11 Status:0x8724aa0800000000
[  333.337532] [      C0] mce: DEBUG: CPU0 Bank:14 Status:0x8724a98800000000
appeared in dmesg:

Bank 0
CTL:	0x0000000000ffffff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000027000001fd
IPID:	0x001000b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 1
CTL:	0x000000000007ffff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000100b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 2
CTL:	0x000000000000000f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000025000001ff
IPID:	0x000200b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 3
CTL:	0x00000000000003ff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000300b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 4
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 5
CTL:	0x0000000000003fff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000500b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 6
CTL:	0x000000000000007f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000023000001f9
IPID:	0x000600b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 7
CTL:	0x00000000000000ff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000025000001ff
IPID:	0x000700b020350000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 8
CTL:	0x00000000000000ff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x00000025000001ff
IPID:	0x000700b020350100
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 9
CTL:	0x000000000000000c
STATUS:	0x054358400005d2b0
ADDR:	0x0000000000000000
MISC0:	0x0010000900000000
CONFIG:	0x00000000000001ff
IPID:	0x000750b00005d2b0
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0050000018a0000c
DEADDR:	0x054358400005d2b0
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 10
CTL:	0x0000000000000000
STATUS:	0x0050000018a0000c
ADDR:	0x054358400005d2b0
MISC0:	0x0010000000000000
CONFIG:	0x00000029000001ff
IPID:	0x000700b018a0000c
SYND:	0x000158400005d2b0
RESV:	0x0000000000000000
DESTAT:	0x0001803100070600
DEADDR:	0x0050000018a0000c
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 11
CTL:	0x0000000000000000
STATUS:	0x0000000300070600
ADDR:	0x4f83058100208912
MISC0:	0x0010004800000000
CONFIG:	0x00000000000001ff
IPID:	0x000700b040000000
SYND:	0x0000000000000042
RESV:	0x0000000000000000
DESTAT:	0x8700aa0800000000
DEADDR:	0x00e2a01a00000020
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 12
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x00000000000001ff
IPID:	0x000700b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0a50000c00000000
DEADDR:	0x0020891200000003
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 13
CTL:	0x0000000000000048
STATUS:	0x0000000000302400
ADDR:	0x0000000000647dac
MISC0:	0x00100c5d00000000
CONFIG:	0x0000001500000006
IPID:	0x000700b000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 14
CTL:	0x00000000000000ff
STATUS:	0x000000030a50000c
ADDR:	0x4f83058100208912
MISC0:	0x0010004800000000
CONFIG:	0x00000000000001ff
IPID:	0x000700b040000000
SYND:	0x0000000000000042
RESV:	0x0000000000000000
DESTAT:	0x8724aa0800000000
DEADDR:	0x0036510100000020
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 15
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 16
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 17
CTL:	0x000000000000003f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000001000000
CONFIG:	0x000000270000007d
IPID:	0x0000009600050f00
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0xd01a000001000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 18
CTL:	0x000000000000003f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000001000000
CONFIG:	0x000000270000007d
IPID:	0x0000009600150f00
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0xd01a000001000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 19
CTL:	0x0000000000003fff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x000000250000007f
IPID:	0x0002002e00000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 20
CTL:	0x0000000000003fff
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x000000250000007f
IPID:	0x0002002e00000001
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 21
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 22
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 23
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 24
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 25
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 26
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0010000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 27
CTL:	0x000000000000001f
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0xd01a000000000000
CONFIG:	0x000000270000007d
IPID:	0x0001002e0000000b
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0010000000000000
MISC2:	0x0010000000000000
MISC3:	0x0010000000000000
MISC4:	0x0010000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 28
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 29
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 30
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bank 31
CTL:	0x0000000000000000
STATUS:	0x0000000000000000
ADDR:	0x0000000000000000
MISC0:	0x0000000000000000
CONFIG:	0x0000000000000000
IPID:	0x0000000000000000
SYND:	0x0000000000000000
RESV:	0x0000000000000000
DESTAT:	0x0000000000000000
DEADDR:	0x0000000000000000
MISC1:	0x0000000000000000
MISC2:	0x0000000000000000
MISC3:	0x0000000000000000
MISC4:	0x0000000000000000
SYND1:	0x0000000000000000
SYND2:	0x0000000000000000

Bert Karwatzki