Files don't get backed up with Distributed File System

Pre-Release and beta version of AISBackup
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

Files don't get backed up with Distributed File System

Post by compumaster »

We use a Distributed File System (DFS) in our network. It seem to be that all those DFS-Linked-Folders don't get backupped.
Barry
Site Admin
Posts: 1529
Joined: Tue Aug 20, 2002 3:16 pm

Distributed File System

Post by Barry »

Do the files get backed up with version 2.2 of AISBackup?

Are you using Windows 2000 DFS?

Barry
Barry
Site Admin
Posts: 1529
Joined: Tue Aug 20, 2002 3:16 pm

Backup DFS

Post by Barry »

I set-up DFS on SBS2003 with two remote shares, one on Windows 2000 and the other on Windows XP. I mapped the DFS on SBS2003 and was able to backup the files.

Please give step-by-step instructions on what is not working so that the problem can be replicated here.

Barry
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

Job details

Post by compumaster »

Well, it can backup 21 files, but the other many thousands of files.

Job log
========

14:58:15 SSTART Backup Session: 2 Started on Mittwoch, 20. September 2006 at 14:58:15 Version: 2.3 (292)
14:58:38 STAT Files Selected For Backup: 1 (1,28 MB)
14:58:38 STAT Already Backed up: 21
14:58:38 STAT Excluded From Backup: No files or folders have been excluded.
14:58:38 DEST Backup destination: [XD]:\R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI\R_Dev+camm_biz.bak
14:58:38 INF Backing up NTFS Security Settings and Alternate Data Streams.
14:58:38 INF Test Method: File Integrity Method.
14:58:38 INF Backing up: 1 Files of 1,00 Megabytes
14:58:38 INF Ignoring: 0 Files
14:58:38 INF Already on Backup: 21 Files
14:58:38 INF Compression Level: High
14:58:38 STAT Estimated Size of Backup: 959,46 KB
14:58:38 INF Backing up NTFS folder security settings
14:58:38 INF Using Media: [BACKUPS W]
14:58:38 INF Testing Backup
14:58:38 RESINF 1 File were backed up and tested successfully
14:58:38 RESULT Completed successfully
14:58:38 INF Backing up Backup Contents File Database Files
14:58:39 STAT Time Calculating Backup: 0 Seconds
14:58:39 STAT Time Backing up: 0 Seconds
14:58:39 STAT Time Testing Backup: 0 Seconds
14:58:39 STAT Total Time: 0 Seconds
14:58:39 STAT Backed up at 106,57 MB per minute
14:58:39 STAT Compression Ratio: 65%
14:58:39 STAT Tested backup at 814,39 MB per minute
14:58:39 SESSEND Backup Session Ended: Mittwoch, 20. September 2006 14:58:39


Here is the job description:
====================

Backup Job: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI Date: Mittwoch, 20. September 2006

Job Settings:

Last Backup: Mittwoch, 20. September 2006 14:58:42
Destination: [XD]:\R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI\R_Dev+camm_biz.bak (External drive: [BACKUPS W], [BACKUPS X])
Last Volume: [BACKUPS W]
Type of Backup: Session Based Retaining: 3 Sessions
Test Backup: Yes: File Integrity Method.
Compression: High
Password Protected: No
Database Path: R:\Admin\Backups\BackupAufträge\
Job File: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI.buz
Log File: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI.log [10,34 MB]
Database File: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI.bdb (Backup contents loaded from backup media)

Network Shares:

\\srv10.lan.compumaster.de\dfs\ Logon with Username:

File and Folder Selection:

Selected for backup:

Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\camm.biz\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\CDI\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\CompuMaster\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\Dev\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\Shared\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\Temp\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\WebSites\

These files have been globally excluded from the backup:

%SystemRoot%\SoftwareDistribution\ %SystemRoot%\System32\CatRoot2\ *.~* *.tmp *:\_RESTORE\ *:\AISRSTR\ *:\System Volume Information\ \Temporary Internet Files B:\ hiberfil.sys pagefile.sys win386.swp

Backup Sessions:

No. Date Comment

2 20.09.2006 14:58 Completed successfully
R_Dev+camm_biz2.bak

1 04.09.2006 15:48 Completed successfully
R_Dev+camm_biz1.bak
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

Files don't get backupped

Post by compumaster »

Hi Barry,

I've identified the potential cause of the problem: in my DFS, I've created following structure (in short)

R:\
R:\Admin\Archiv
R:\Admin\Backups
R:\Dev
R:\Shared\Technik
R:\Shared\HR
R:\Temp
...

In AISBackup, I created a Backup task to backup "R:\Shared".

The files of R:\Shared are backed up as long as they reside in the DFS share itself; if the files are located on a different share which is linked into the DFS tree, AISBackup can't see those files.

So, a R:\Shared\test.txt would be seen (because it is in the DFS share itself), but not a R:\Shared\HR\test.txt (because it is a different file share for the folder HR).


Additionally, I can't browse through the DFS linked folders; let's say I can't expand a folder R:\Dev (which is a DFS link), but I can expand a folder R:\Shared because it is a normal folder.


Again, there is a difference between a normal windows share and the DFS share:
A normal DFS share is connected in AISBackup program as follows:
"Profile$ an srv10.lan.compumaster.de (P: As COMPUMASTER\adminsupport)"
The DFS share is connected in the AISBackup program as follows:
"dfs an srv10.lan.compumaster.de (R: As )"
You see that "R: As " without the name of the user who should be there.


For your information: our DFS tree is a tree hosted in our ADS and is provided by both of our domain servers (both win2003).


Does this helps you to reproduce this issue?

Regards
Jochen
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

Files don't get backupped

Post by compumaster »

When I click on one of these DFS links on the left tree in the select files/folder dialog, is show on the right site a message "Special folder called a Reparse Point"

Reparse points are very normal here and typically handled automatically by the operating system or application - looks like your application does something special here that it not automatically supports those reparse points.

BTW: reparse points can be e. g.
- DFS links to other shares
- NTFS junction folders
Barry
Site Admin
Posts: 1529
Joined: Tue Aug 20, 2002 3:16 pm

Reparse Point

Post by Barry »

Are you using the latest build of AISBackup (292)? There was a bug in builds 291 and before where drives mapped within AISBackup are incorrectly shown as reparse points - the folder attribute was not correctly initialised so assumed a random number. You may download AISBackup from here:

www.aiscl.co.uk/downloadaisbackup.htm

AISBackup does not backup data from reparse junctions, it just backs up the junction (reparse) information, perhaps this is the problem? AISBackup expects the actual data folders to be mapped.

Barry
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

Reparse Point

Post by compumaster »

Yes, I'm using 292.

> AISBackup does not backup data from reparse junctions, it just backs
> up the junction (reparse) information, perhaps this is the problem?
Yes, I think so. This should be the problem. Can you please fix this issue?
Barry
Site Admin
Posts: 1529
Joined: Tue Aug 20, 2002 3:16 pm

Reparse Points

Post by Barry »

This is not a fault, AISBackup is correctly backing up the reparse point, the data should be backed up from the 'real' share.

There is a potential problem when backing up data from reparse points:

Folder C:\Documents and Settings contains a folder called C:\My Settings which contains a reparse junction to point to C:\Documents and Settings, when processing the files to backup AISBackup would get into an infinite loop!

We maybe could add as an enhancement 'backup data from this reparse point, however, would we backup the data from its real location or the data from the virtual location?

When I set-up DFS the data did get backed up from the DFS mapped drives - I did not create any reparse point (by accident or design) so perhaps I need step-by-step instruction on how a DFS share is set-up which is failing to backup.

Does AISBackup show the DFS folders as reparse points and show the real location of the data? - this was added to AISBackup because there are several reparse point junctions in Windows Vista, e.g. Documents and Settings is no longer a real folder - but is a reparse point of type junction created to ensure that legacy Windows programs still work.

Under Vista: Assuming you backup the C:\ drive AISBackup backs up the data folder C:\Users which Documents and Settings ‘points’ to and the reparse information – it has to be done this way or AISBackup would not be able to restore Windows Vista correctly and backing up data from Documents and Settings twice (Documents and Settings and C:\Users) would be incorrect.

Barry
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

DFS & Reparse Points

Post by compumaster »

Hi Barry,

What is required for our DFS is that the reparse point to the real shares work just as normal - as normal as an XCOPY: without any special logic: all files which are available after that reparse point shall be backed up just as the files would be there directly.

The windows Vista restore feature in of no interest here. But okay, I agree that it might be of interest for other users. So here my suggestion to provide an option to change the behaviour regarding the reparse points. This option could be defined per backup task. If the user says "Backup files and folders in reparse points", then you show and backup all files and folders within those junctions/reparse points as they were files in a normal folder.

If you agree, I invite you to take a look onto my machine. I've got a remote support software here for this task which is very cool, easy and powerful. It will take maybe 5 minutes for you to get the remoting session running. If you like, please send an e-mail to my address jwezel {at] removedbybarry [dot} de. Then I'll send you the required link for it.

Then, when you can see my system here, you can see how our DFS is set up, make tests or whatever you like to do.
Barry
Site Admin
Posts: 1529
Joined: Tue Aug 20, 2002 3:16 pm

DFS Problems

Post by Barry »

I am e-mailing you about working on a solution to this problem. Most users of AISBackup do not use DFS as it is quite a specialised server environment feature, however, I am keen to find a solution to the problem.

Barry
Barry
Site Admin
Posts: 1529
Joined: Tue Aug 20, 2002 3:16 pm

DFS Problem

Post by Barry »

At last! I have seen the problem with AISBackup version 2.3. Please confirm that version 2.2 does in fact work and the (important) changes we made for Vista are causing this problem. An update should be available by the end of next week - and the changes made after you confirm that version 2.2 does work.

2.2 may be downloaded from:

www.aiscl.co.uk/build272/aisbi272.exe

I still see a problem if the DFS Link is back to a PC, e.g. \\DESKTOP1\C and AISBackup maps the drive on the \\DESKTOP PC - it cannot 'see' the files on the link \\DESKTOP1\C (which is named 'Link to desktop c', e.g. it cannot backup from (or open from explorer) \\SERVER\DFSRoot\Link to desktop c).

Barry
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

DFS Links

Post by compumaster »

Hi Barry,

yes, with 2.2 all is working fine for me. All DFS links can be browsed and backupped as they should.

-Jochen
Barry
Site Admin
Posts: 1529
Joined: Tue Aug 20, 2002 3:16 pm

Post by Barry »

Build 293 of AISBackup version 2.3 has been uploaded, this should correct the problem with DFS:

http://www.aiscl.co.uk/build293/aisbi293.exe

(readers of this post please note: This message was posted on 6 October 2006 and build 293 may have been superseded – please check the download page)

Barry
compumaster
Posts: 11
Joined: Fri Feb 03, 2006 9:04 am

DFS links

Post by compumaster »

looks as it would work, now :D
thanks!
Post Reply