Difference between revisions of "Hardware Issues"

From VistApedia
Jump to: navigation, search
(→‎Setting up Backup for Linux box (esp with DVD))
Line 1: Line 1:
−
hi
+
=== Setting up a Linux DVD For Backup ===
−
cialis drugs
+
 
−
[http://cialis-drugs.pills-pharmacy.net cialis drugs]
+
Initial Post of question to messaage board
−
cialis drugs
+
<pre>
 +
I need a reliable backup solution for my linux server.
 +
Here are methods I have explored, unsuccessfully so
 +
far.  Let me first mention that our office also has a
 +
new Windows Server running our billing package.  My
 +
initial thoughts were to copy my linux data to the
 +
Windows server, and then let their backup process save
 +
my data.
 +
 
 +
1. Install Services for Linux (SFU) put out by Windows
 +
onto our Windows server.  I then created a NFS share.
 +
I can view the directory contents of the Windows share
 +
from my linux box, but for the life of me I can't get
 +
write permission.  You have to run a Windows
 +
namemapper to map linux users to Windows users, and
 +
then give that user write permission.  Sounds easy.  I
 +
can't get it to work.  The permission system on NTFS
 +
is a bit complex to me.
 +
 
 +
2. Run a Samba server on my linux box.  When I do
 +
this, I can see the drive from a Windows laptop, and I
 +
might even be able to write to it (I can't remember).
 +
But when I try to find the file when browsing from the
 +
Windows Server, I can't find it.  Not sure if I have
 +
to join Windows "domain" to work.  This descends into
 +
a murky realm for me of ActiveDirectories.  Also, I'm
 +
not sure if my iptables is filtering out the samba
 +
ports etc.
 +
 
 +
3. Run a Samba client on my linux box.  I haven't
 +
tried this, but again I worry that I would have to
 +
discover how to join the Windows "domain" and be
 +
validated.
 +
 
 +
4. Get scp to work on my Windows server, and scp the
 +
needed data up.  This would probably work, but I would
 +
need to use and 'expect' script to supply the password
 +
etc if it is going to be automated.  This seems a bit
 +
klunky, and will probably be my last resort.
 +
 
 +
5. Install a DVD writer on my linux box.  This is what
 +
I am currently trying to do.  I successfully installed
 +
a new USB 2.0 IO card, and have now plugged the drive
 +
in.  I'm lost as to what to do now.  I have read
 +
multiple web sites, and I'm overwhelmed.  Right off
 +
the bat the install demos talk about possible kernel
 +
upgrades etc.  It seems that cdrtools is one route to
 +
use.  I would have to purchase a commercial license.
 +
The money is not such an issue, but I would want to be
 +
sure it was going to work.
 +
 
 +
6. Purchase and install tape backup system for the
 +
linux box.  This may well be a great options, but I
 +
have no experience with this.
 +
 
 +
 
 +
If anyone has any helpful thoughts or pointers (esp
 +
regarding option 5 above), I would be very grateful.
 +
 
 +
Kevin
 +
</pre>
 +
 
 +
<pre>
 +
Samba is not my expertise, so I won't presume to give you debugging
 +
advice.  I will say that I have been able to get Samba and Windows
 +
working quite well together to share files and printers on multiple
 +
occasions.  When I have had problems using Linux as a server, it is
 +
usually because on the Linux side, I have not created the users with
 +
smbpasswd program (just because they exist in /etc/passwd doesn't mean
 +
that they exist for Samba - although I think there is now an option to
 +
propagate changes back and forth).  You can also webmin and swat to
 +
manage Samba via a browser.
 +
 
 +
Since Windows file attributes are not the same as Linux, I only
 +
recommend using Windows to backup your Linux files by first creating a
 +
tar archive on Linux and moving the tar archive to Linux.  By the way,
 +
to move a single file from Linux to Windows, you don't need Samba, just
 +
use WinSCP3 on Windows.
 +
 
 +
Getting a USB DVD burner to work on any contemporary Linux should be
 +
trivial.  When I got it working, I just powered down the PC, plugged in
 +
the DVD-ROM drive (a Sony drive that Chris Richardson put inside a box
 +
that provided power and interface electronics), powered up the DVD and
 +
powered up the PC.  K3b (my burning software) recognized the DVD
 +
immediately.  That PC runs the Debian Sarge installed via a Knoppix 3.6
 +
Linux live CD.  What Linux distribution and release are you running and
 +
what kernel?  If you connect a USB flash drive to the PC, is it
 +
recognized?  [In theory, you need not power it down, but just to
 +
simplify debugging, I like to start from a cold power up.]
 +
 
 +
I recommend creating a tar archive for backup.  Remember to backup your
 +
journal files too.
 +
 
 +
...
 +
-- Bhaskar
 +
</pre>
 +
 
 +
<pre>
 +
>use.  I would have to purchase a commercial license.
 +
>The money is not such an issue, but I would want to be
 +
>sure it was going to work.
 +
>
 +
 
 +
As Bhaskar mentioned k3b is an excellent solution for burning CD and
 +
DVD's.
 +
On this 64 bit Debian/Sarge laptop I did
 +
 
 +
# apt-get install k3b dvd+rw-tools cdrdao
 +
 
 +
You have the option of creating a seperate group (cdrom I think) for
 +
burning - or you can assign the permissions to the various tools during
 +
the setup when you first call the application.
 +
 
 +
I am not aware of any need for a commercial license for any of the
 +
above.  I would also expect the USB device to be well supported with
 +
most of the recent stock kernels.  Just as an aside, with 2.6.x you
 +
don't need to use SCSI emulation for IDE CDROM drives, which is nice.
 +
 
 +
>6. Purchase and install tape backup system for the
 +
>linux box.  This may well be a great options, but I
 +
>have no experience with this.
 +
> 
 +
>
 +
My first experience with tape backup with GNU/Debian was with an old
 +
Colorado floppy based mini-tape backup system with the ftape drivers -
 +
it was slow, but worked perfectly (restore and backup).
 +
 
 +
If you add a SCSI tape backup you will have a huge array of software
 +
solutions - from something as simple as 'tos' (tape oriented
 +
backups-perl driven) to enterprise tools like Amanda. I have used
 +
various HP SCSI backup systems in the past and don't recall any
 +
problems.
 +
 
 +
And as mentioned, if you have questions about Samba and Windows John
 +
Terpstra's series of books and essays are excellent. BTW, he is a first
 +
rate speaker if you ever have the chance of attending one of his
 +
lectures or seminars, you will really get a huge boost up with regards
 +
to networking in heterogenous environments.
 +
 
 +
I hope this is of some help. --Ismet
 +
</pre>
 +
 
 +
<pre>
 +
Whoa, quite a bit here...
 +
 
 +
1.  Windows bites, do it our way or the highway.
 +
2.  Samba - Get yourself the book by John Terpstra - Samba 3 By Example
 +
-
 +
Practical Exercises to Successful Deployment.
 +
and/or
 +
Download my smb.conf tutorial file and have a go at joining that
 +
domain....
 +
http://oswizards.com/samba-instruct.conf
 +
If you would like I can give you access to one of my Linux Admin
 +
courses online.  You can study the Samba material to see if it clarifies things
 +
a little.  Samba is a huge subject, especially if you are going to deploy
 +
with 500+ uses.  I highly recommend the book.
 +
 
 +
I don't think that will solve your problems though, you need to backup
 +
the Linux server.
 +
3.  See number 2 above.
 +
4.  You can share your private key/identity with the client and you
 +
will not have to supply a password when you execute your command.  You could do
 +
this with linux boxes easy, windows would be a hassle. In Linux I could
 +
issue the command,  scp -r /var/data/* jerome@someotherhost.org:mydata/
 +
 
 +
5.  Oh yeah... you could install a DVD writer, CDR or an additional HDD
 +
or both.
 +
 
 +
Here are a couple tools for you.  Mondo Resuce
 +
http://www.microwerks.net/~hugo/about/about.html
 +
 
 +
I use another command line program from a cron job called rdiff-backup
 +
-
 +
http://www.nongnu.org/rdiff-backup/  It can take a snapshot of your
 +
filesystem whenever you tell it to, it also keeps diffs on all files
 +
that have been changed since the last backup.  You can actually restore a
 +
file from a specific date and time.  I snapshot at 3:10am onto a spare drive
 +
in the machine, I also snapshot my databases every hour.  You can use
 +
Mondo to
 +
create an entire system backup onto CD, HDD, NFS or DVD -
 +
http://www.ccp14.ac.uk/ccp14admin/linux-server/mondorescue/dvd_mondo.html
 +
 
 +
Keep yourself clear of Windows and your choices will be plentiful and
 +
your difficulty will be diminished.
 +
 
 +
Setup another Linux Samba Server for the Windows clients/users to store
 +
their data on, then back that one up with the tools above.
 +
 
 +
Have Fun!!!... and test your backups regularly to make sure you are
 +
indeed backing up your data.
 +
--Mark Street
 +
</pre>
 +
 
 +
 
 +
<pre>
 +
I just recalled another tool/method that you might want to look at -
 +
namely rsync
 +
 
 +
Here is a nice summary of one method employing it with automated
 +
scripts:
 +
 
 +
http://www.tux.org/~tbr/rsync/rsynchowto.html
 +
 
 +
Rsync is a fantastic tool - especially when combined with ssh.
 +
 
 +
Ismet / Ismet B. Kursunoglu, MD, FCCP
 +
</pre>
 +
 
 +
<pre>
 +
> 1. Install Services for Linux (SFU) put out by Windows
 +
> onto our Windows server. 
 +
<...snipped...>
 +
 
 +
Linux + NTFS is experimental at best still.  Do not know much about the
 +
SFU deal from M$, but would not put too much trust in it for my obvious
 +
prejudices. ;-)
 +
 
 +
> 2. Run a Samba server on my linux box. 
 +
<...snipped...>
 +
 
 +
Samba on the Linux box will allow the M$ boxes to see and mount it as a
 +
share potentially.  Possible idea, not the greatest though.
 +
 
 +
> 3. Run a Samba client on my linux box. 
 +
<...snipped...>
 +
 
 +
If you are using RH (or one of the Fedora or CentOS forks), there are
 +
some built in RH specific tools for Samba (redhat-config-samba for RH).
 +
Not too hard using them.  Otherwise, there are a few HOW-To's on the
 +
Samba subject.
 +
 
 +
> 4. Get scp to work on my Windows server, and scp the
 +
> needed data up. 
 +
<...snipped...>
 +
 
 +
This is actually one of the easier solutions you have presented so far
 +
that could run unattended potentially.
 +
 
 +
scp is part of the SSH package typically (along with sftp).  This would
 +
be one of your easiest solutions.  Tarball (with gz or bz2 compression
 +
depending on the amount of data you wish to back up), scp the tarball
 +
to remote backup location directory.  You can make a simple script and
 +
cron job to do this on a regular basis.
 +
 
 +
> 5. Install a DVD writer on my linux box.
 +
<...snipped...>
 +
>
 +
 
 +
There is k3b which also noted by Bhaskar is freeware.  Nice tool
 +
overall once you get the DVD up and running, can handle CD and DVD burning.
 +
 
 +
At issue, you will be starting a large DVD collection potentially in
 +
time.
 +
 
 +
> 6. Purchase and install tape backup system for the
 +
> linux box.  This may well be a great options, but I
 +
> have no experience with this.
 +
>
 +
 
 +
Old school, but possible via Amanda,
 +
 
 +
And finally...another Linux based solution presented is Bacula.  I
 +
personally have not played with it (yet), but one of my guys is using
 +
it
 +
for one of our clients on a regular basis.  This is a better or more
 +
modern idea than Amanda, allows for secure file transfer to a remote
 +
machine, and such.  http://www.bacula.org/ for their web site, and
 +
yes...it is cross platformed as well.
 +
 
 +
--- Crawford, The Linux ETC Company
 +
</pre>

Revision as of 11:49, 23 March 2005

Setting up a Linux DVD For Backup

Initial Post of question to messaage board 

I need a reliable backup solution for my linux server.
 Here are methods I have explored, unsuccessfully so
far.  Let me first mention that our office also has a
new Windows Server running our billing package.  My
initial thoughts were to copy my linux data to the
Windows server, and then let their backup process save
my data.

1. Install Services for Linux (SFU) put out by Windows
onto our Windows server.  I then created a NFS share. 
I can view the directory contents of the Windows share
from my linux box, but for the life of me I can't get
write permission.  You have to run a Windows
namemapper to map linux users to Windows users, and
then give that user write permission.  Sounds easy.  I
can't get it to work.  The permission system on NTFS
is a bit complex to me.

2. Run a Samba server on my linux box.  When I do
this, I can see the drive from a Windows laptop, and I
might even be able to write to it (I can't remember). 
But when I try to find the file when browsing from the
Windows Server, I can't find it.  Not sure if I have
to join Windows "domain" to work.  This descends into
a murky realm for me of ActiveDirectories.  Also, I'm
not sure if my iptables is filtering out the samba
ports etc.

3. Run a Samba client on my linux box.  I haven't
tried this, but again I worry that I would have to
discover how to join the Windows "domain" and be
validated.

4. Get scp to work on my Windows server, and scp the
needed data up.  This would probably work, but I would
need to use and 'expect' script to supply the password
etc if it is going to be automated.  This seems a bit
klunky, and will probably be my last resort.

5. Install a DVD writer on my linux box.  This is what
I am currently trying to do.  I successfully installed
a new USB 2.0 IO card, and have now plugged the drive
in.  I'm lost as to what to do now.  I have read
multiple web sites, and I'm overwhelmed.  Right off
the bat the install demos talk about possible kernel
upgrades etc.  It seems that cdrtools is one route to
use.  I would have to purchase a commercial license. 
The money is not such an issue, but I would want to be
sure it was going to work.

6. Purchase and install tape backup system for the
linux box.  This may well be a great options, but I
have no experience with this.


If anyone has any helpful thoughts or pointers (esp
regarding option 5 above), I would be very grateful.

Kevin

Samba is not my expertise, so I won't presume to give you debugging 
advice.  I will say that I have been able to get Samba and Windows 
working quite well together to share files and printers on multiple 
occasions.  When I have had problems using Linux as a server, it is 
usually because on the Linux side, I have not created the users with 
smbpasswd program (just because they exist in /etc/passwd doesn't mean 
that they exist for Samba - although I think there is now an option to 
propagate changes back and forth).  You can also webmin and swat to 
manage Samba via a browser.

Since Windows file attributes are not the same as Linux, I only 
recommend using Windows to backup your Linux files by first creating a 
tar archive on Linux and moving the tar archive to Linux.  By the way, 
to move a single file from Linux to Windows, you don't need Samba, just 
use WinSCP3 on Windows.

Getting a USB DVD burner to work on any contemporary Linux should be 
trivial.  When I got it working, I just powered down the PC, plugged in 
the DVD-ROM drive (a Sony drive that Chris Richardson put inside a box 
that provided power and interface electronics), powered up the DVD and 
powered up the PC.  K3b (my burning software) recognized the DVD 
immediately.  That PC runs the Debian Sarge installed via a Knoppix 3.6 
Linux live CD.  What Linux distribution and release are you running and 
what kernel?  If you connect a USB flash drive to the PC, is it 
recognized?  [In theory, you need not power it down, but just to 
simplify debugging, I like to start from a cold power up.]

I recommend creating a tar archive for backup.  Remember to backup your 
journal files too.

...
-- Bhaskar

>use.  I would have to purchase a commercial license. 
>The money is not such an issue, but I would want to be
>sure it was going to work.
>

As Bhaskar mentioned k3b is an excellent solution for burning CD and 
DVD's.
On this 64 bit Debian/Sarge laptop I did

# apt-get install k3b dvd+rw-tools cdrdao

You have the option of creating a seperate group (cdrom I think) for 
burning - or you can assign the permissions to the various tools during 
the setup when you first call the application.

I am not aware of any need for a commercial license for any of the 
above.  I would also expect the USB device to be well supported with 
most of the recent stock kernels.  Just as an aside, with 2.6.x you 
don't need to use SCSI emulation for IDE CDROM drives, which is nice.

>6. Purchase and install tape backup system for the
>linux box.  This may well be a great options, but I
>have no experience with this.
>  
>
My first experience with tape backup with GNU/Debian was with an old 
Colorado floppy based mini-tape backup system with the ftape drivers - 
it was slow, but worked perfectly (restore and backup).

If you add a SCSI tape backup you will have a huge array of software 
solutions - from something as simple as 'tos' (tape oriented 
backups-perl driven) to enterprise tools like Amanda. I have used 
various HP SCSI backup systems in the past and don't recall any 
problems.

And as mentioned, if you have questions about Samba and Windows John 
Terpstra's series of books and essays are excellent. BTW, he is a first 
rate speaker if you ever have the chance of attending one of his 
lectures or seminars, you will really get a huge boost up with regards 
to networking in heterogenous environments.

I hope this is of some help. --Ismet

Whoa, quite a bit here...

1.  Windows bites, do it our way or the highway.
2.  Samba - Get yourself the book by John Terpstra - Samba 3 By Example 
- 
Practical Exercises to Successful Deployment.
and/or 
Download my smb.conf tutorial file and have a go at joining that 
domain....
http://oswizards.com/samba-instruct.conf
If you would like I can give you access to one of my Linux Admin 
courses online.  You can study the Samba material to see if it clarifies things 
a little.  Samba is a huge subject, especially if you are going to deploy 
with 500+ uses.  I highly recommend the book. 

I don't think that will solve your problems though, you need to backup 
the Linux server.
3.  See number 2 above.
4.  You can share your private key/identity with the client and you 
will not have to supply a password when you execute your command.  You could do 
this with linux boxes easy, windows would be a hassle.  In Linux I could 
issue the command,  scp -r /var/data/* jerome@someotherhost.org:mydata/

5.  Oh yeah... you could install a DVD writer, CDR or an additional HDD 
or both.

Here are a couple tools for you.  Mondo Resuce 
http://www.microwerks.net/~hugo/about/about.html

I use another command line program from a cron job called rdiff-backup 
- 
http://www.nongnu.org/rdiff-backup/  It can take a snapshot of your 
filesystem whenever you tell it to, it also keeps diffs on all files 
that have been changed since the last backup.  You can actually restore a 
file from a specific date and time.  I snapshot at 3:10am onto a spare drive 
in the machine, I also snapshot my databases every hour.  You can use 
Mondo to 
create an entire system backup onto CD, HDD, NFS or DVD - 
http://www.ccp14.ac.uk/ccp14admin/linux-server/mondorescue/dvd_mondo.html 

Keep yourself clear of Windows and your choices will be plentiful and 
your difficulty will be diminished.

Setup another Linux Samba Server for the Windows clients/users to store 
their data on, then back that one up with the tools above. 

Have Fun!!!... and test your backups regularly to make sure you are 
indeed backing up your data.
--Mark Street



I just recalled another tool/method that you might want to look at - 
namely rsync

Here is a nice summary of one method employing it with automated 
scripts:

http://www.tux.org/~tbr/rsync/rsynchowto.html

Rsync is a fantastic tool - especially when combined with ssh.

Ismet / Ismet B. Kursunoglu, MD, FCCP

> 1. Install Services for Linux (SFU) put out by Windows
> onto our Windows server.  
<...snipped...>

Linux + NTFS is experimental at best still.  Do not know much about the
SFU deal from M$, but would not put too much trust in it for my obvious
prejudices. ;-)

> 2. Run a Samba server on my linux box.  
<...snipped...>

Samba on the Linux box will allow the M$ boxes to see and mount it as a
share potentially.  Possible idea, not the greatest though.

> 3. Run a Samba client on my linux box.  
<...snipped...>

If you are using RH (or one of the Fedora or CentOS forks), there are
some built in RH specific tools for Samba (redhat-config-samba for RH).
Not too hard using them.  Otherwise, there are a few HOW-To's on the
Samba subject.

> 4. Get scp to work on my Windows server, and scp the
> needed data up.  
<...snipped...>

This is actually one of the easier solutions you have presented so far
that could run unattended potentially.

scp is part of the SSH package typically (along with sftp).  This would
be one of your easiest solutions.  Tarball (with gz or bz2 compression
depending on the amount of data you wish to back up), scp the tarball 
to remote backup location directory.  You can make a simple script and 
cron job to do this on a regular basis.

> 5. Install a DVD writer on my linux box. 
<...snipped...>
> 

There is k3b which also noted by Bhaskar is freeware.  Nice tool 
overall once you get the DVD up and running, can handle CD and DVD burning.

At issue, you will be starting a large DVD collection potentially in
time.

> 6. Purchase and install tape backup system for the
> linux box.  This may well be a great options, but I
> have no experience with this.
> 

Old school, but possible via Amanda,

And finally...another Linux based solution presented is Bacula.  I
personally have not played with it (yet), but one of my guys is using 
it
for one of our clients on a regular basis.  This is a better or more
modern idea than Amanda, allows for secure file transfer to a remote
machine, and such.  http://www.bacula.org/ for their web site, and
yes...it is cross platformed as well.

--- Crawford, The Linux ETC Company
Retrieved from "https://vistapedia.com/index.php?title=Hardware_Issues&oldid=200"