Friday, January 6, 2012

[sharepointdiscussions] Digest Number 4368

Messages In This Digest (10 Messages)

Messages

1a.

Re: Moss 2007 indexing- anyway to speed things up?

Posted by: "Ikkon" n_ikkon@yahoo.com   n_ikkon

Thu Jan 5, 2012 5:52 am (PST)



Patrick,

I see that you are indicating that you have close to a 5TB DB. How many items is your farm crawling? How many web apps do you currently have? How many WFE's and APP servers do you have?

What I have done to speed up crawling is to split out the content source into several content sources. This allows better flexibility with crawl schedules and crawling web apps that might be more important.

You have to see, which web apps have the most content and then plan accordingly.

--- In sharepointdiscussions@yahoogroups.com, Patrick Reeves <patrickwreeves@...> wrote:
>
> My current moss 2007 farm is taking 24-26 hours for an incremental crawl
> (current total size for the database is pushing 5TB). Besides tossing
> beefier hardware at the farm, is there a way to speed this up? Since I
> have several web apps on the farm, I was thinking of splitting up the web
> apps into two or more content sources. Would this allow a
> more parallel approach, instead of the current serial method of having all
> the web apps I the same content source? Anyone have experience with this?
>
> Patrick
>
>
> [Non-text portions of this message have been removed]
>

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (4)
1b.

Re: Moss 2007 indexing- anyway to speed things up?

Posted by: "Patrick Reeves" patrickwreeves@gmail.com   patrick_w36

Thu Jan 5, 2012 2:02 pm (PST)



Currently we have 12 web apps. Our farm is one app/Central admin server
and 2 WFEs
You touched on what I was looking at as a solution, splitting up the web
apps into separate content sources. My main concern is, how many crawls
can I safely have running at the same time?

On Thu, Jan 5, 2012 at 5:52 AM, Ikkon <n_ikkon@yahoo.com> wrote:

> **
>
>
> Patrick,
>
> I see that you are indicating that you have close to a 5TB DB. How many
> items is your farm crawling? How many web apps do you currently have? How
> many WFE's and APP servers do you have?
>
> What I have done to speed up crawling is to split out the content source
> into several content sources. This allows better flexibility with crawl
> schedules and crawling web apps that might be more important.
>
> You have to see, which web apps have the most content and then plan
> accordingly.
>
>
> --- In sharepointdiscussions@yahoogroups.com, Patrick Reeves
> <patrickwreeves@...> wrote:
> >
> > My current moss 2007 farm is taking 24-26 hours for an incremental crawl
> > (current total size for the database is pushing 5TB). Besides tossing
> > beefier hardware at the farm, is there a way to speed this up? Since I
> > have several web apps on the farm, I was thinking of splitting up the web
> > apps into two or more content sources. Would this allow a
> > more parallel approach, instead of the current serial method of having
> all
> > the web apps I the same content source? Anyone have experience with this?
> >
> > Patrick
> >
> >
> > [Non-text portions of this message have been removed]
> >
>
>
>

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (4)
1c.

Re: Moss 2007 indexing- anyway to speed things up?

Posted by: "Ikkon" n_ikkon@yahoo.com   n_ikkon

Thu Jan 5, 2012 2:12 pm (PST)



12 web apps... ok. That is not bad. How is your SQL setup? How many SQL servers?
Not sure how big your user population is, but here are a couple of things to keep in mind regarding crawl times.

Determining crawl times/crawl performance depends on a number of factors, here are some of the more important ones

** Number of Indexing/Crawl threads
** Size of documents, type of documents (mix), ifilters (single or multi threaded)
** Memory/CPU utilization/NIC utilization on the source and destination server (this is very important, especially with the 2-1 setup that you have)
** Indexing a WSS 3.0 is more efficient since it uses the change log. (this is very important, because you should have the temp dbs on their own LUNs and have ample amount of space to grow so it can handle the changes)
** BDC for Structured data uses dedicated crawl time so this should be factored in

So in a nutshell what are some broad estimates?

** If it's 10s to hundreds of MBs – measure it in minutes
** If it's 10s to hundreds of GBs – measure it in hours
** If it's 1-10TB+ - measure it in days to a week
** 10-100TB – measure it in weeks

If you split them into separate content sources, you just have to know which content sources have the most items and try not to run the big content sources together.

YA

--- In sharepointdiscussions@yahoogroups.com, Patrick Reeves <patrickwreeves@...> wrote:
>
> Currently we have 12 web apps. Our farm is one app/Central admin server
> and 2 WFEs
> You touched on what I was looking at as a solution, splitting up the web
> apps into separate content sources. My main concern is, how many crawls
> can I safely have running at the same time?
>
>
>
>
> On Thu, Jan 5, 2012 at 5:52 AM, Ikkon <n_ikkon@...> wrote:
>
> > **
> >
> >
> > Patrick,
> >
> > I see that you are indicating that you have close to a 5TB DB. How many
> > items is your farm crawling? How many web apps do you currently have? How
> > many WFE's and APP servers do you have?
> >
> > What I have done to speed up crawling is to split out the content source
> > into several content sources. This allows better flexibility with crawl
> > schedules and crawling web apps that might be more important.
> >
> > You have to see, which web apps have the most content and then plan
> > accordingly.
> >
> >
> > --- In sharepointdiscussions@yahoogroups.com, Patrick Reeves
> > <patrickwreeves@> wrote:
> > >
> > > My current moss 2007 farm is taking 24-26 hours for an incremental crawl
> > > (current total size for the database is pushing 5TB). Besides tossing
> > > beefier hardware at the farm, is there a way to speed this up? Since I
> > > have several web apps on the farm, I was thinking of splitting up the web
> > > apps into two or more content sources. Would this allow a
> > > more parallel approach, instead of the current serial method of having
> > all
> > > the web apps I the same content source? Anyone have experience with this?
> > >
> > > Patrick
> > >
> > >
> > > [Non-text portions of this message have been removed]
> > >
> >
> >
> >
>
>
> [Non-text portions of this message have been removed]
>

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (4)
2a.

Need help with Managed Path

Posted by: "Kevin Lai" kclai66@yahoo.com   kclai66

Thu Jan 5, 2012 7:56 am (PST)



Hello SharePoint experts,
 
I was trying to setup a virtual directory to our MOSS site
but ran into difficulties.
 
1.       From the IIS Manager, I created a virtual
directory name “virtualpath”, linked to the physical path: “C:\inetpub\wwwroot\wss\VirtualDirectories\80\virtualpath”.
2.       As suggested by the post http://www.knowsharepoint.com/2007/08/exclude-managed-path.html,
I added “Network Service” with read & execute permission.
3.       I added read and execute permission to the
folder as well for “Network Service”.
4.       I copied a very simple index.htm to the directory
5.       In Central Administration page, I added “virtualpath”
as a wildcard inclusion Managed Path.
6.       When I try the URL https://mysite/virtualpath/index.htm,
nothing shows up.
 
Are the above procedures right? What have I missed?
 
Thank you for your help!
 
 
Kevin

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (3)
2b.

Re: Need help with Managed Path

Posted by: "Paul Stork" pstork@att.net   pstorkoh

Thu Jan 5, 2012 9:47 am (PST)



Just skip step 5 and it should work. The blog mentions that creating a Wildcard EXCLUSION Managed path was required in SharePoint 2003 but is no longer needed in 2007. You wouldn’t use a Wildcard inclusion managed path in either version for this.

Paul Papanek Stork

Chief Architect • ShareSquared, Inc. • <http://www.sharesquared.com/> http://www.ShareSquared.com

The SharePoint Solution Experts!

<https://mvp.support.microsoft.com/profile=6D05CC8D-32ED-4626-A29E-142DC7A680E0> SharePoint MVP, MBA, MCT, MCSE+I, MCSA, MCSD, MCDBA, MCITP, MCPD

<mailto:Paul.Stork@ShareSquared.com> Paul.Stork@ShareSquared.com • 800.445.1279 x404

blog: <http://dontpapanic.com/blog> http://dontpapanic.com/blog • twitter: <http://twitter.com/pstork> @pstork

From: sharepointdiscussions@yahoogroups.com [mailto:sharepointdiscussions@yahoogroups.com] On Behalf Of Kevin Lai
Sent: Thursday, January 05, 2012 10:57 AM
To: sharepointdiscussions@yahoogroups.com
Subject: [sharepointdiscussions] Need help with Managed Path

Hello SharePoint experts,

I was trying to setup a virtual directory to our MOSS site
but ran into difficulties.

1. From the IIS Manager, I created a virtual
directory name “virtualpath”, linked to the physical path: “C:\inetpub\wwwroot\wss\VirtualDirectories\80\virtualpath”.
2. As suggested by the post http://www.knowsharepoint.com/2007/08/exclude-managed-path.html,
I added “Network Service” with read & execute permission.
3. I added read and execute permission to the
folder as well for “Network Service”.
4. I copied a very simple index.htm to the directory
5. In Central Administration page, I added “virtualpath”
as a wildcard inclusion Managed Path.
6. When I try the URL https://mysite/virtualpath/index.htm,
nothing shows up.

Are the above procedures right? What have I missed?

Thank you for your help!


Kevin

[Non-text portions of this message have been removed]

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (3)
2c.

Re: Need help with Managed Path

Posted by: "Kevin Lai" kclai66@yahoo.com   kclai66

Thu Jan 5, 2012 10:40 am (PST)



Thanks Paul!
 
I removed the Managed Path from the Central Adminstration, and refresh the web site from the IIS.
 
One super simple html file test1.htm was created with this content
<html>
Test1
</html>
 
Then in this URL https://mysite/virtualpath/test1.htm, nothing shows up. (Note that it I try a non-existence path such as mysite/none, HTTP 404 is shown - this somehow proves that "virtualpath" was indeed available). Right-click to View Source, I saw:
 
<!DOCTYPEHTML PUBLIC "-//W3C//DTD
HTML 4.0 Transitional//EN">
<HTML><HEAD>
<METAcontent="text/html; charset=windows-1252" http-equiv=Content-Type></HEAD>
<BODY></BODY></HTML>
Looks like generated code, not the above simple htm file I typed.
 
Any idea?
 
Thank you very much!
 
 
Kevin
 

________________________________
From: Paul Stork <pstork@att.net>
To: sharepointdiscussions@yahoogroups.com
Sent: Thursday, January 5, 2012 9:47 AM
Subject: RE: [sharepointdiscussions] Need help with Managed Path


 

Just skip step 5 and it should work. The blog mentions that creating a Wildcard EXCLUSION Managed path was required in SharePoint 2003 but is no longer needed in 2007. You wouldn’t use a Wildcard inclusion managed path in either version for this.

Paul Papanek Stork

Chief Architect • ShareSquared, Inc. • <http://www.sharesquared.com/> http://www.ShareSquared.com

The SharePoint Solution Experts!

<https://mvp.support.microsoft.com/profile=6D05CC8D-32ED-4626-A29E-142DC7A680E0> SharePoint MVP, MBA, MCT, MCSE+I, MCSA, MCSD, MCDBA, MCITP, MCPD

<mailto:Paul.Stork@ShareSquared.com> Paul.Stork@ShareSquared.com • 800.445.1279 x404

blog: <http://dontpapanic.com/blog> http://dontpapanic.com/blog • twitter: <http://twitter.com/pstork> @pstork

From: sharepointdiscussions@yahoogroups.com [mailto:sharepointdiscussions@yahoogroups.com] On Behalf Of Kevin Lai
Sent: Thursday, January 05, 2012 10:57 AM
To: sharepointdiscussions@yahoogroups.com
Subject: [sharepointdiscussions] Need help with Managed Path

Hello SharePoint experts,

I was trying to setup a virtual directory to our MOSS site
but ran into difficulties.

1. From the IIS Manager, I created a virtual
directory name “virtualpath”, linked to the physical path: “C:\inetpub\wwwroot\wss\VirtualDirectories\80\virtualpath”.
2. As suggested by the post http://www.knowsharepoint.com/2007/08/exclude-managed-path.html,
I added “Network Service” with read & execute permission.
3. I added read and execute permission to the
folder as well for “Network Service”.
4. I copied a very simple index.htm to the directory
5. In Central Administration page, I added “virtualpath”
as a wildcard inclusion Managed Path.
6. When I try the URL https://mysite/virtualpath/index.htm,
nothing shows up.

Are the above procedures right? What have I missed?

Thank you for your help!

Kevin

[Non-text portions of this message have been removed]

[Non-text portions of this message have been removed]

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (3)
3a.

Need help on Managed Path

Posted by: "Kevin Lai" kclai66@yahoo.com   kclai66

Thu Jan 5, 2012 7:58 am (PST)



Hello SharePoint experts,
 
I was trying to setup a virtual directory to our MOSS site
but ran into difficulties.
 1.       From the IIS Manager, I created a virtual
directory name “virtualpath”, linked to the physical path: “C:\inetpub\wwwroot\wss\VirtualDirectories\80\virtualpath”.
2.       As suggested by the post http://www.knowsharepoint.com/2007/08/exclude-managed-path.html,
I added “Network Service” with read & execute permission.
3.       I added read and execute permission to the
folder as well for “Network Service”.
4.       I copied a very simple index.htm to the directory
5.       In Central Administration page, I added “virtualpath”
as a wildcard inclusion Managed Path.
6.       When I try the URL https://mysite/virtualpath/index.htm,
nothing shows up.
 Are the above procedures right? What did I miss?
 Thank you for your help!
 
Kevin

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (3)
3b.

Re: Need help on Managed Path

Posted by: "Ikkon" n_ikkon@yahoo.com   n_ikkon

Thu Jan 5, 2012 9:21 am (PST)



so, I am confused as to what you are trying to do. Are you trying to create a managed path for one of your current web apps?

Your writing on this post is hard to read.

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (3)
3c.

Re: Need help on Managed Path

Posted by: "Kevin Lai" kclai66@yahoo.com   kclai66

Thu Jan 5, 2012 9:45 am (PST)



Hi Ikkon,
 
Thanks for your response!
 
Yes, I am trying to create a managed path so that I can place my aspx pages with VB code behind to the path, e.g.,
https://mysite/virtualpath/myapplication.aspx
 
Thanks,
 
Kevin
 
-- I am re-posting my question below --
I was trying to setup a virtual directory to our MOSS site but ran into difficulties.

1. From the IIS Manager, I created a virtual directory name “virtualpath”, linked to the physical path: “C:\inetpub\wwwroot\wss\VirtualDirectories\80\virtualpath”.

2. As suggested by the post http://www.knowsharepoint.com/2007/08/exclude-managed-path.html, I added “Network Service” with read & execute permission.

3. I added read and execute permission to the folder as well for “Network Service”.

4. I copied a very simple index.htm to the directory

5. In Central Administration page, I added “virtualpath” as a wildcard inclusion Managed Path.

6. When I try the URL https://mysite/virtualpath/index.htm, nothing shows up.

Are the above procedures right? What have I missed?

________________________________
From: Ikkon <n_ikkon@yahoo.com>
To: sharepointdiscussions@yahoogroups.com
Sent: Thursday, January 5, 2012 9:21 AM
Subject: [sharepointdiscussions] Re: Need help on Managed Path


 

so, I am confused as to what you are trying to do. Are you trying to create a managed path for one of your current web apps?

Your writing on this post is hard to read.

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (3)
4.

Access 2010 linked tables with SharePoint 2010

Posted by: "Peter Brunone" peter.brunone@gmail.com   peter_brunone

Thu Jan 5, 2012 10:50 am (PST)



Has anyone here worked with Access web databases? We're helping a client
who has contracted a third party to create an Access DB (our job is to get
it into SharePoint).

For various reasons, we're going with the "create linked tables with
SharePoint lists" approach, and I'm wondering if there's a way to set up
one-way synchronization (so that offline users, when they sync, do not get
the sum total of all records from SharePoint). Nobody should be entering
the same data by accident -- and if they do, they should be prompted to
resolve the conflict -- so is this possible?

Cheers,

Peter

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (1)
Recent Activity
Visit Your Group
Y! Messenger

All together now

Host a free online

conference on IM.

Dog Fanatics

on Yahoo! Groups

Find people who are

crazy about dogs.

Ads on Yahoo!

Learn more now.

Reach customers

searching for you.

Need to Reply?

Click one of the "Reply" links to respond to a specific message in the Daily Digest.

Create New Topic | Visit Your Group on the Web
MARKETPLACE

Stay on top of your group activity without leaving the page you're on - Get the Yahoo! Toolbar now.

Posted by at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)