How To Handle Very Frequent Updates To A Lucene Index
Nov 4, 2010
Am using Lucene.net 3.0 in my Application which as frequent updates to index.
But when new data on a forum it's not available in the search . it's taking few minutes to update index.
how can i overcome this.....
View 1 Replies
Similar Messages:
Sep 15, 2010
1) Accpet the item in TxtItem in comma seperated values like (Apple, Mango, Orange etc.). Store that item in array object (objArray) in acending order."
2) Create the object of the dropdown list objDropDwon on runtime and fill its items from objArray."
3) Create server side table and add rows on runtime."
4) Add objDropDown to the each row of the table."
5) Handle Selected index changed event. Display the current selected name on screen
Note: give me code guide how can done 1 to 5 step.
View 1 Replies
Oct 25, 2010
this is my first post as you will easily see i'm quite new to this and am struggling. i have some working code that pulls user information from our active directory. the only way i've seen so far to display these results is to place it in a "For Each" statement.this can then be output to the page. however if there are lots of results this can take a while, so i was wondering if it was possible to be able to step through and handle the results by an index? here is what i have done so far:
[Code]....
the other issue i have is that i wish to be able to change the search criteria to the "Path" and then go to an idividual when clicked on.i have checked that this would work but cannot get my head around how i would make the result "Clickable" As you can see i have also tried using list boxes but was unable to format the results sufficiently.
View 3 Replies
Aug 6, 2010
how to handle selected index changed event for dropdown list in footer template in grid view
View 2 Replies
Dec 6, 2010
I'm trying to figure out how to write this in LINQ.
Lets say I have a table of book reviews. Each book has a rating of 1 to 5. At the moment I am getting all book reviews by a bookID. I want to then say "Get the score that occurs most frequently for those given reviews". So if Book1 has reviews of 1, 1, 2, and 4, the statement would return 1. If Book1 has reviews of 1, 2, 2, 4, it would return 2.
View 1 Replies
Jan 25, 2010
I made a function that sends emails to some members or subscribers , lets assume the email is a birthday greeting, if today is the member's birthday the system will send himher a greeting.The question is: How can I call or trigger this function everyday at a specific time automaticly !? The website uses .net Framework 3.5 & published on IIS6 .
View 2 Replies
Dec 5, 2010
I have a website hosted with sql 2008 database on Godaddy. Here's my problem descriptionbefore I actually begin implementing.Entries are made in a table named "XYZ" by a third party program. Now, there are multipleclients (could be asp.net ajax web based or vb.net desktop clients which I have not decided yet) who
read data from this "XYZ" table every 10-15 seconds. The connection string used by these clients would be same. If I have 10000-20000 clients making connections and querying same table, would that cause any breakdown? Since my connection string is same, connection pooling isautomatically in place.
What else do you think I need to take care of? Or is there any better way to implement this setup?Also, should I go for asp.net ajax client implementation or vb.net(c#) client implemtation ?Your inputs would be highly helpful to me. I am looking for a medium to long term solution to thissetup.
View 10 Replies
Apr 17, 2010
I am trying to get a handle on Solrnet and interacting an ASP.NET site with a Solr server. However, the sample app (on the code repository) is MVC based ,does anyone know of a version in plain vanilla ASP.NET?
View 1 Replies
May 26, 2010
-Edit- Important: I updated the code to not use obsoluete functions. Now only the NoSuchDirectoryException issue remains
Edit: NOTE i can bypass the NoSuchDirectoryException by creating the folder in a winform app and copy it. However i still have a LockObtainFailedException issue if i dont shut down properly.I have an issue with (Lucene.net 2.9.2
[https://svn.apache.org/repos/asf/lucene/lucene.net/tags/]. It throws a lock exception. After poking around i notice these things.
My code below works in an app bit when calling in Application_Start i get a NoSuchDirectoryException.Not closing the writer (as my code doesnt do below) i WILL get a LockObtainFailedException with the message
Lock obtain timed out: SimpleFSLock@<FULL_PATH> from either app or asp.net
These thread hinted when spawning threads they get less permissions then i do (but! my main thread has problems as well...) and one solution is to impersonate IIS. I am using visual studios 2010. I am not sure how full blown it is but my attempt to impersonate it failed.
So my question is how do i have lucene create the directory and not throw an exception if dont close the writer for some reason (such as power going out)?
http://stackoverflow.com/questions/2341163/why-is-my-lucene-index-getting-locked/2499285#2499285
http://stackoverflow.com/questions/1123517/lucene-net-and-i-o-threading-issue/1123981#1123981
static IndexWriter writer = null;
static void lucene_init()
{
[code].....
View 1 Replies
Jan 13, 2010
I want to start a new project I need performance as well as a neat and robust GUI
about the performance I have around 2 millions documents which I like to index'em by the help of lucene installed on linux due to its performance and security.
and about GUI I'd like to have flexible and professional look website and since I'm experienced with .net I'd like to retrieve the lucene's result and show it in my own way.
I've heard about some RESTful services available inside the lucene but I don't have any clue according to that and how to connect these two together.
how can I connect asp.net to lucene?
View 2 Replies
Oct 21, 2010
How do I sort my results in a random order. my code looks something like this at the moment:
Dim searcher As IndexSearcher = New IndexSearcher(dir, True)
Dim collector As TopScoreDocCollector = TopScoreDocCollector.create(100, True)
searcher.Search(query, collector)
Dim hits() As ScoreDoc = collector.TopDocs.scoreDocs
For Each sDoc As ScoreDoc In hits
'get doc and return
Next
View 1 Replies
Jun 11, 2010
I am looking for any open source application that uses lucene.net. I am working on a complicated web application and would like to see how others have implemented lucene.net.
View 2 Replies
Feb 24, 2011
We have a web service method which accepts some data and puts it in Lucene index. We use it to index new and updated entries from our asp.net web app.
These entries are stored in a large SQL Server table (20M rows and growing), and I need a way to be able to reindex the whole table in case if current index gets deleted or corrupted. I'm not sure what's the optimal way to retrieve chunks of data from a large table. Currently, we use the fact that the table has PK which is autoincrement, so we get chunks of 1000 rows until it starts to return nothing. Kind of like (in pseudo language):
i = 0
while (true)
{
SELECT col1, col2, col3 FROM mytable WHERE pk between i and i + 1000
.... if result is empty 20 times in a row, break ....
.... otherwise send result to web service to reindex ....
i = i + 1000
}
This way, we don't need to SELECT COUNT(*) which would be a big performance killer, and we just move up the pk values until we stop getting any results. This has it's con: if we have a hole greater than 20,000 values somewhere in the table, it will stop indexing assuming it reached the end, but that's a tradeoff we have to live for now.
way of getting data from a table to index? I would assume we are not the first ones facing this problem - search engines are widely used nowadays :)
View 3 Replies
May 14, 2010
Situation:I have an ASP .NET application that will search through docs using Lucene. I want to run the initial indexing (the index will be incremental after the initial run so there wont be need to index the whole directory again in future). Currently, I have about 5GB of docs (45000files).Problem: My application times out before completing the process. I have altered the TimeOut like this:HttpContext.Current.Server.ScriptTimeout = 200000;but it still does not complete the process.
View 1 Replies
May 6, 2010
Is there a pre-existing library to extract plain text form Open XML file formats (e.g. docx, pptx, and xlsx) files?
I require this to populate a lucene.net index.
I've found this example which extracts text from docx and it seems to work okay. But before building my own solution based on this I was wondering if there's something already available for the other file formats?
View 2 Replies
May 14, 2010
I'm working on a project where we're using Windows Desktop Search (WDS) to index files on a web share and then later allow the user to search via a website for documents in the share.
These documents are transferred to the share via FTP, however it would seem that either the computer never goes idle to index or at some point the indexing stops. Is there a way from the command line or within the program itself to force this to happen without having to re-invent the wheel? Using .NET 3.5 and C#.
View 1 Replies
Feb 26, 2010
Here is my code in SQL
[Code]....
Error i am facing is :
Msg 8668, Level 16, State 0, Line 2
Cannot create the clustered index 'RateViewIndex' on view 'NoteToPass.dbo.RateView' because the select list of the view contains an expression on result of aggregate function or grouping column. Consider removing expression on result of aggregate function or grouping column from select list.
View 1 Replies
Feb 2, 2010
what is difference in cluster index and noncluster index?
which is faster?how many cluster index and non cluster index per table?
what is composite primary key?on how many columns we can create composite key?
hao many maximum composite key's we can create on one table?
View 2 Replies
Jan 25, 2011
I have two control page in my aspx page. first one left side "tree view",second one right side " form design".Form design will change based on tree view selected index changed.i have 4 level child node(site, master , slave, space). I have seperate forms to each level of node.
cannot update tree node when update the forms. so i reload tree view.
now i need how to auto selected index change to tree node.
ex.
1 parent node
1.1 child node
1.2 child node
i have update "1.2 child node" rename to "1.3 child node"
and reload treeview so it will chage...
how set tree node.selected index = 1.3 child node....
View 3 Replies
Jan 3, 2011
gvOff.DataSource = o.ViewData(dCity.SelectedValue);
gvOff.DataBind();
gvOff.Columns[0].HeaderText = "ZZZZZZZZ";
gvOff.Columns[1].HeaderText = "YYYYYYYY";
gvOff.Columns[2].HeaderText = "XXXXXXXX";
Header count is correct.
AutoGenerateColumns: Flase/True ( i tried both)
If i remove the gvOff.Columns[index].HeaderText portions, GridView works fine, but when i put the gvOff.Columns[0].HeaderText, i get the exceptional error.
, i couldn't solve it. If you need further info, inform me.
EDITED:
Hold on! I commented the HeaderText portion and tested
int i = gvOffer.Columns.Count;
I found count is 0 eventhough the columns print out with DataBind()... Why?
NOTE: AutoColumn in this case is set to true. I guess i will have to edit the column
names from DataTable.
View 1 Replies
Aug 2, 2010
Is it frowned upon to work in visual developer express directly from the published web site? I'm having real problems getting my changes recompiled I think. I've even gone so far as to stop iis and then build the web site, but changes just arent getting
published. New pages I add seem to work fine, but pages that were already there before seem to not want to update. I change variables and its like they are just ignored. When I go to the web root, the changes are reflected in the files, it just appears that the changes arent making it to the running config.Is it recommended to work with a project outside of IIS and then just republish the site over and over again? Or do I have another issue?
View 2 Replies
Aug 10, 2010
I need to work with some rows of data and then update the database as I do using SQL similar to the following:
[Code]....
My question is: Is there any reason at all why I'd want to use EF for this?
I'm using Entity Frameworks in this project so I'd even be willing to use it to maintain project consistency if all else were equal. But I'm thinking it is just more work in this case. Instead of a simple SQL statement, I must query the data, change it, and then update it, which is not only less work but far less efficient as well.
Perhaps EF has an efficient way of doing stuff like this that I just don't yet know about?
View 4 Replies
Apr 10, 2010
where should we use clustered index and non clustered index.i mean in day to day use which on e to choice and how to make decision.
View 8 Replies
Jun 15, 2010
I have a situation in which I select an account and I want to bring back its details. This is a single UpdatePanel round trip and its quite quick.
In addition, I need to bring back some transactional information which is from a much bigger table and takes a couple of seconds for the query to come back. Ideally, I would like to put this into a second update panel and update this additional information once it has been received, but after the first update panel has updated i.e. the user sees:
Change account See account details (almost instant) See transactional info (2 seconds later) The only way I can think of doing this is to use javascript to cause a SECOND postback once the account details have been retrieved to get the transaction information. Is there a better way?
View 1 Replies
Feb 8, 2011
My company sales staff uses an Access database for order tracking (mostly). I would like to transfer some of the data to an externally hosted SQL 2005 database so that I can allow sales to check order status online while outside of the office. The Access database is on our internal file server. Is there a way to to update the data from the Access file to the external database on an hourly basis without opening a gaping hole in security? Is there a method or scripting language that might be more secure than another in this situation?
View 1 Replies