Long time Voice interaction and get directives failed

Hi swasey,

#1

Now I can send the audio by reading from the stream when recording. Libcurl can call my readfunction many times until I stop recording. Each time I read 320 from the buffer and return 320. When finished, return 0. It's all correct and can get the correct response. But ,it also costs long time to receive audio data. About 10 secs or more. I dump the libcurl. The log shows receiving http header data is in short time, but receiving the audio data is very slow.

code in comment

The log is as follows:

/**************

//receive header in short time

09-08 22:25:42.847 <= Recv data, 0000005208 bytes (0x00001458) header content... //receive audio in long time

09-08 22:25:42.847 <= Recv SSL data, 0000000005 bytes (0x00000005) audio content

09-08 22:25:50.852 == Info: Operation timed out after 10835 milliseconds with 5208 bytes received

09-08 22:25:50.897 multi perform completed...

******************/

I think I do it in right way what you said. But the result is not good.

//read function (long code, but works)
postdata *ud = (postdata*) userdata;
if (ud)
{
    jobject audio_stream = ud->stream;
    ring_buffer_t*  rb_audio = ud->rb_audio;
    int ringsize = 0;
    do
    {
        jbyteArray audiobuffer = NULL;
        jbyte* p_audio = NULL;
        JNIEnv* env = get_env();
        jclass class_ins = (*env)->GetObjectClass(env, audio_stream);
        jmethodID method_read = java_get_method(env, class_ins, inputstream_read);
        jmethodID method_available = java_get_method(env, class_ins, inputstream_available);
        jmethodID method_close = java_get_method(env, class_ins, inputstream_close);
        int available = (int) (*env)->CallIntMethod(env, audio_stream, method_available); 
        audiobuffer = (*env)->NewByteArray(env, AUDIOBUF_SIZE);
        int realRead = (int) (*env)->CallIntMethod(env, audio_stream, method_read, audiobuffer, 0, AUDIOBUF_SIZE); 
        //finished
        if(realRead == -1 || realRead > AUDIOBUF_SIZE)
        {
            (*env)->CallVoidMethod(env, audio_stream, method_close);
            (*env)->DeleteLocalRef(env, audiobuffer);
            (*env)->DeleteLocalRef(env, class_ins);
            return 0;
        }
        p_audio = (*env)->GetByteArrayElements(env, audiobuffer, JNI_FALSE);
        //copy to ring buffer
        ring_buffer_queue_arr(rb_audio, (char*)p_audio, realRead);
        (*env)->ReleaseByteArrayElements(env, audiobuffer, p_audio, JNI_FALSE);
        (*env)->DeleteLocalRef(env, audiobuffer);
        (*env)->DeleteLocalRef(env, class_ins);
    }while (ringsize < AUDIOBUF_SIZE);
    LOGI(TAG, "copy to net buffer, used size[%d]", ringsize);
    ring_buffer_dequeue_arr(rb_audio, data, AUDIOBUF_SIZE);
    LOGI(TAG, "read audio stream and return[%d]", AUDIOBUF_SIZE);
    return AUDIOBUF_SIZE;
}
LOGI(TAG, "on_read finish");
return 0;

Hi swasey,

#1

I found the reason for costing long time to receive response with audio data.

It's that the multi_perform don't return until reaching timeout.

Now I use curl progress callback to make multi_perform return.

int on_progress(void *p, curl_off_t dltotal, curl_off_t dlnow, curl_off_t ultotal, curl_off_t ulnow)
{
    struct myprogress *myp = (struct myprogress *)p;
    if(write_finished == 1)    
    {
      write_finished = 0;
      return 1;
    }

    return 0;
}

When returning 1, multi_perform returns. Then play the response with audio.

The point is I should know when the response is to be the end. I use this way as follows in curl write callback

size_t on_write(char *data, size_t size, size_t count, void* userdata)
{
    size_t realsize = size * count;

    //The max write buffer of curl is 16K (16384)                    
    if(realsize < 16384)
    {
        write_finished = 1; 
    }
    ...
}

In many situation it works. But here are 2 questions:

1. As you can see that when the response size is n*16384, multi_perform will not return until reaching timeout.

2. If this is a right way, how to know the response real size and then set write_finished=1 in function on_write?