Replication failures , Connectivity Tests Failing from only one DC in forest.

hi,

we have had windows active directory domain many years running few issues.

in last 2 days replication 1 of our 2008r2 dc's has stopped.

the forest consists of 1 2008r2 dc  , 4 2003r2 dc's in various states around country.

about 2 days ago lost network connectivity our san the 2008r2 server running on virtual machine vmware esxi  5.0. loss of connection around minute.

it seem after there has been no replication 4 other servers.

dcdiag reports first of ldap bind failed error 8341 when testing the 2008r2 dc , when run 1 of 2003 dc's.

repadmin /showrepl shows last attempt failed ad partitions 2008r2 dc, others 2003 dc's last attempt successful.

using ldp.exe can connect 2008r2 dc bind fails using default bind method of sspi. if use bind method digest can bind 2008r2 dc. if attempt bind 2003dc's there no problem bind method.

if try repadmin /replicate 2003dc 2008r2 dc message

dsreplicasync() failed status -2146893022 (0x80090322)

can't retrieve message string -2146893022 (0x80090322), error 1815

this error message appearing in event logs

      starting test: systemlog
         * system event log test
         error event occured.  eventid: 0x40000004
            time generated: 01/14/2015   14:43:49
            event string: kerberos client received a

krb_ap_err_modified error server

sopm-dc1$.  target name used was

ldap/b6400cd3-2bcd-4f8b-866b-3dd06716188f._msdcs.shimadzu.com.au.

 this indicates password used encrypt

the kerberos service ticket different than

that on target server. commonly, due

to identically named  machine accounts in the

target realm (sopm.shimadzu.com.au), , the

client realm.   please contact system

administrator.

dcdiag has various errors such following

      starting test: kccevent
         * kcc event log test
         warning event occured.  eventid: 0x8000061e
            time generated: 01/14/2015   15:38:09
            event string: domain controllers in following site that

can replicate directory partition on this

transport unavailable.

and this

dc: sopm-dc1.sopm.shimadzu.com.au
            domain: sopm.shimadzu.com.au

                 
               test: authentication (auth)
                  error: authentication failed specified credentials
                  [error details: 1396 (type: win32 - description: logon failure: target account name incorrect.) - add connection failed]
                 
               test: basic (basc)
                  error: no ldap connectivity
                  error: no wmi connectivity
                  [error details: 0x800706ba (type: hresult - facility: win32, description: rpc server unavailable.) - connection wmi server failed]

i trying understand causing authentication errors, think basis of issues see.

i have disabled firewalls on servers has made no difference.

any appreciated

i believe have solved problem after many hours of searching.
                                      here is the fixed problem:
1 stop kdc and mark disabled
2 run netdom command line and reset secure channel pswd
                                           netdom resetpwd /server:server_name /userd:domain_name\administrator /passwordd:administrator_password
server_name name of server server kdc running
3 restart bad dc, wait 15 minutes bad ad synchronize pdc (make sure made connection bad dc pdc in sites/services)
4 re-enable kdc , reboot dc

after ran ldp.exe again , able bind without issues.

dcdiag tests not failing connectivity or authentication.

repadmin /showreps reports replication success.

                                     

Windows Server  >  Directory Services