Page 1 of 2

Files don't get backed up with Distributed File System

Posted: Mon Sep 04, 2006 2:58 pm
by compumaster
We use a Distributed File System (DFS) in our network. It seem to be that all those DFS-Linked-Folders don't get backupped.

Distributed File System

Posted: Tue Sep 05, 2006 8:45 am
by Barry
Do the files get backed up with version 2.2 of AISBackup?

Are you using Windows 2000 DFS?

Barry

Backup DFS

Posted: Tue Sep 05, 2006 9:42 am
by Barry
I set-up DFS on SBS2003 with two remote shares, one on Windows 2000 and the other on Windows XP. I mapped the DFS on SBS2003 and was able to backup the files.

Please give step-by-step instructions on what is not working so that the problem can be replicated here.

Barry

Job details

Posted: Wed Sep 20, 2006 2:06 pm
by compumaster
Well, it can backup 21 files, but the other many thousands of files.

Job log
========

14:58:15 SSTART Backup Session: 2 Started on Mittwoch, 20. September 2006 at 14:58:15 Version: 2.3 (292)
14:58:38 STAT Files Selected For Backup: 1 (1,28 MB)
14:58:38 STAT Already Backed up: 21
14:58:38 STAT Excluded From Backup: No files or folders have been excluded.
14:58:38 DEST Backup destination: [XD]:\R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI\R_Dev+camm_biz.bak
14:58:38 INF Backing up NTFS Security Settings and Alternate Data Streams.
14:58:38 INF Test Method: File Integrity Method.
14:58:38 INF Backing up: 1 Files of 1,00 Megabytes
14:58:38 INF Ignoring: 0 Files
14:58:38 INF Already on Backup: 21 Files
14:58:38 INF Compression Level: High
14:58:38 STAT Estimated Size of Backup: 959,46 KB
14:58:38 INF Backing up NTFS folder security settings
14:58:38 INF Using Media: [BACKUPS W]
14:58:38 INF Testing Backup
14:58:38 RESINF 1 File were backed up and tested successfully
14:58:38 RESULT Completed successfully
14:58:38 INF Backing up Backup Contents File Database Files
14:58:39 STAT Time Calculating Backup: 0 Seconds
14:58:39 STAT Time Backing up: 0 Seconds
14:58:39 STAT Time Testing Backup: 0 Seconds
14:58:39 STAT Total Time: 0 Seconds
14:58:39 STAT Backed up at 106,57 MB per minute
14:58:39 STAT Compression Ratio: 65%
14:58:39 STAT Tested backup at 814,39 MB per minute
14:58:39 SESSEND Backup Session Ended: Mittwoch, 20. September 2006 14:58:39


Here is the job description:
====================

Backup Job: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI Date: Mittwoch, 20. September 2006

Job Settings:

Last Backup: Mittwoch, 20. September 2006 14:58:42
Destination: [XD]:\R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI\R_Dev+camm_biz.bak (External drive: [BACKUPS W], [BACKUPS X])
Last Volume: [BACKUPS W]
Type of Backup: Session Based Retaining: 3 Sessions
Test Backup: Yes: File Integrity Method.
Compression: High
Password Protected: No
Database Path: R:\Admin\Backups\BackupAufträge\
Job File: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI.buz
Log File: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI.log [10,34 MB]
Database File: R_Dev+camm_biz+CompuMaster+Shared+Websites+Temp+CDI.bdb (Backup contents loaded from backup media)

Network Shares:

\\srv10.lan.compumaster.de\dfs\ Logon with Username:

File and Folder Selection:

Selected for backup:

Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\camm.biz\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\CDI\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\CompuMaster\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\Dev\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\Shared\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\Temp\
Files and Folders from Folder: \\srv10.lan.compumaster.de\dfs\WebSites\

These files have been globally excluded from the backup:

%SystemRoot%\SoftwareDistribution\ %SystemRoot%\System32\CatRoot2\ *.~* *.tmp *:\_RESTORE\ *:\AISRSTR\ *:\System Volume Information\ \Temporary Internet Files B:\ hiberfil.sys pagefile.sys win386.swp

Backup Sessions:

No. Date Comment

2 20.09.2006 14:58 Completed successfully
R_Dev+camm_biz2.bak

1 04.09.2006 15:48 Completed successfully
R_Dev+camm_biz1.bak

Files don't get backupped

Posted: Fri Sep 22, 2006 2:30 pm
by compumaster
Hi Barry,

I've identified the potential cause of the problem: in my DFS, I've created following structure (in short)

R:\
R:\Admin\Archiv
R:\Admin\Backups
R:\Dev
R:\Shared\Technik
R:\Shared\HR
R:\Temp
...

In AISBackup, I created a Backup task to backup "R:\Shared".

The files of R:\Shared are backed up as long as they reside in the DFS share itself; if the files are located on a different share which is linked into the DFS tree, AISBackup can't see those files.

So, a R:\Shared\test.txt would be seen (because it is in the DFS share itself), but not a R:\Shared\HR\test.txt (because it is a different file share for the folder HR).


Additionally, I can't browse through the DFS linked folders; let's say I can't expand a folder R:\Dev (which is a DFS link), but I can expand a folder R:\Shared because it is a normal folder.


Again, there is a difference between a normal windows share and the DFS share:
A normal DFS share is connected in AISBackup program as follows:
"Profile$ an srv10.lan.compumaster.de (P: As COMPUMASTER\adminsupport)"
The DFS share is connected in the AISBackup program as follows:
"dfs an srv10.lan.compumaster.de (R: As )"
You see that "R: As " without the name of the user who should be there.


For your information: our DFS tree is a tree hosted in our ADS and is provided by both of our domain servers (both win2003).


Does this helps you to reproduce this issue?

Regards
Jochen

Files don't get backupped

Posted: Fri Sep 22, 2006 4:30 pm
by compumaster
When I click on one of these DFS links on the left tree in the select files/folder dialog, is show on the right site a message "Special folder called a Reparse Point"

Reparse points are very normal here and typically handled automatically by the operating system or application - looks like your application does something special here that it not automatically supports those reparse points.

BTW: reparse points can be e. g.
- DFS links to other shares
- NTFS junction folders

Reparse Point

Posted: Fri Sep 22, 2006 7:00 pm
by Barry
Are you using the latest build of AISBackup (292)? There was a bug in builds 291 and before where drives mapped within AISBackup are incorrectly shown as reparse points - the folder attribute was not correctly initialised so assumed a random number. You may download AISBackup from here:

www.aiscl.co.uk/downloadaisbackup.htm

AISBackup does not backup data from reparse junctions, it just backs up the junction (reparse) information, perhaps this is the problem? AISBackup expects the actual data folders to be mapped.

Barry

Reparse Point

Posted: Mon Sep 25, 2006 8:07 am
by compumaster
Yes, I'm using 292.

> AISBackup does not backup data from reparse junctions, it just backs
> up the junction (reparse) information, perhaps this is the problem?
Yes, I think so. This should be the problem. Can you please fix this issue?

Reparse Points

Posted: Mon Sep 25, 2006 9:58 am
by Barry
This is not a fault, AISBackup is correctly backing up the reparse point, the data should be backed up from the 'real' share.

There is a potential problem when backing up data from reparse points:

Folder C:\Documents and Settings contains a folder called C:\My Settings which contains a reparse junction to point to C:\Documents and Settings, when processing the files to backup AISBackup would get into an infinite loop!

We maybe could add as an enhancement 'backup data from this reparse point, however, would we backup the data from its real location or the data from the virtual location?

When I set-up DFS the data did get backed up from the DFS mapped drives - I did not create any reparse point (by accident or design) so perhaps I need step-by-step instruction on how a DFS share is set-up which is failing to backup.

Does AISBackup show the DFS folders as reparse points and show the real location of the data? - this was added to AISBackup because there are several reparse point junctions in Windows Vista, e.g. Documents and Settings is no longer a real folder - but is a reparse point of type junction created to ensure that legacy Windows programs still work.

Under Vista: Assuming you backup the C:\ drive AISBackup backs up the data folder C:\Users which Documents and Settings ‘points’ to and the reparse information – it has to be done this way or AISBackup would not be able to restore Windows Vista correctly and backing up data from Documents and Settings twice (Documents and Settings and C:\Users) would be incorrect.

Barry

DFS & Reparse Points

Posted: Wed Sep 27, 2006 4:42 pm
by compumaster
Hi Barry,

What is required for our DFS is that the reparse point to the real shares work just as normal - as normal as an XCOPY: without any special logic: all files which are available after that reparse point shall be backed up just as the files would be there directly.

The windows Vista restore feature in of no interest here. But okay, I agree that it might be of interest for other users. So here my suggestion to provide an option to change the behaviour regarding the reparse points. This option could be defined per backup task. If the user says "Backup files and folders in reparse points", then you show and backup all files and folders within those junctions/reparse points as they were files in a normal folder.

If you agree, I invite you to take a look onto my machine. I've got a remote support software here for this task which is very cool, easy and powerful. It will take maybe 5 minutes for you to get the remoting session running. If you like, please send an e-mail to my address jwezel {at] removedbybarry [dot} de. Then I'll send you the required link for it.

Then, when you can see my system here, you can see how our DFS is set up, make tests or whatever you like to do.

DFS Problems

Posted: Wed Sep 27, 2006 5:23 pm
by Barry
I am e-mailing you about working on a solution to this problem. Most users of AISBackup do not use DFS as it is quite a specialised server environment feature, however, I am keen to find a solution to the problem.

Barry

DFS Problem

Posted: Wed Sep 27, 2006 10:25 pm
by Barry
At last! I have seen the problem with AISBackup version 2.3. Please confirm that version 2.2 does in fact work and the (important) changes we made for Vista are causing this problem. An update should be available by the end of next week - and the changes made after you confirm that version 2.2 does work.

2.2 may be downloaded from:

www.aiscl.co.uk/build272/aisbi272.exe

I still see a problem if the DFS Link is back to a PC, e.g. \\DESKTOP1\C and AISBackup maps the drive on the \\DESKTOP PC - it cannot 'see' the files on the link \\DESKTOP1\C (which is named 'Link to desktop c', e.g. it cannot backup from (or open from explorer) \\SERVER\DFSRoot\Link to desktop c).

Barry

DFS Links

Posted: Thu Sep 28, 2006 10:37 am
by compumaster
Hi Barry,

yes, with 2.2 all is working fine for me. All DFS links can be browsed and backupped as they should.

-Jochen

Posted: Fri Oct 06, 2006 4:00 pm
by Barry
Build 293 of AISBackup version 2.3 has been uploaded, this should correct the problem with DFS:

http://www.aiscl.co.uk/build293/aisbi293.exe

(readers of this post please note: This message was posted on 6 October 2006 and build 293 may have been superseded – please check the download page)

Barry

DFS links

Posted: Wed Oct 18, 2006 8:16 am
by compumaster
looks as it would work, now :D
thanks!